It likely won't go away. The "Attractive Person" moodlet isn't necessarily about someone your Sim just met but rather a Sim they find very attractive (have a lot in common with, appreciate their skill growth/job growth, etc). I think it's a nice little moodlet, and it only boosts their mood, at least it's not a negative moodlet!