I haven't really had a ton of experience, I don't mind wandering guests, but maybe you could try serving a meal early in the party and using the Call to Meal Everyone interaction, or whatever it's called, that you get when your sim clicks on the group meal dish. That would get everyone in the room to eat, and if there is enough entertaining stuff in the room, hopefully they won't leave.