I'm not quite sure which of my many questions the "yes" is in answer to there. Where does the rejection come in?

I wonder (this is of course complete speculation and may be entirely wrong) whether part of what makes the infatuation last so long is that part of your mind sees it as being necessary for a relationship to develop.