Manderley is correct, you can put your animals in your inventory. This is how you take them to the fair, and it is also how you can move them with you if you move your household. If you don't do that, you would indeed leave them behind though.
Once you're at your new place and have the needed objects placed, click the coop or shed, and Assign Animal. Your animals in your inventory will come up in a popup window.