Well, this is a matter of concern, but it never happened to me. There are only two adults in my house, and both of them go to a job. So I have to call a babysitter to keep the six toddlers in my house alive, and she works fine. She kept all the scattered toys back in the toybox, she fed all the sims who were hungry, and even played with them.
You can try calling another babysitter.