I haven't done it in awhile, but if I'm understanding you correctly, it can't be done.
You currently are living in House A in Isla Paradiso, and now want to move 3 people from House A to the new plot on Island B. Everyone else you want to leave in House A?
If that's correct, you can't do it. House A will remain as part of your properties, just as Island B currently is part of your properties. In order to split up the household, you'd have to move the unwanted sims out of the household entirely, so they wouldn't have access to either property - otherwise, all you're doing is transferring your household to a new residence amongst all your properties.
What you could try doing is moving the entire household to the new lot, then sell the old house so it's not part of your assets, and then move the unwanted sims out (and hopefully into the house you just sold).