Do you do romantic interactions beforehand, or do you just get them to woohoo?
If you get them to interact before they woohoo, the bar will go up instead of down. It's kind of like when you're trying to get them to be a romantic interest - you need to get them to the point where they're willing to do the interaction.