I've had guests leave parties early, too. Sometimes they just have someplace else to be, like a job. Even at night Sims have to leave to go to work.
Mine only leaves if they are not happy. And almost aways that have to do something with toilets... or the lag of it.
Therefore, build a toiletroom, right besides the fiesta room. 10 just for man, 20 for woman, just to make sure that everyone has a place to empty whatever they need to empty. Works fine by me.
I mean, works fine by me ingame members. So don't take me wrong.