HELP: Why Do I Lose Interest In Guys Who Like Me Back?

I was thinking, what is wrong with me. Thinking it’s them, but most of the time it isn’t. I know the difference between a connection with someone and just not into them, that not the case, I’ll genuinely like guys but I LOSE INTEREST. I MADE A CONNECTION TO WHY (maybe): I was in a relationship for 4 years with a guy who really didn’t seem to want me, I was basically a trophy girl for him, he has said it. WE BROKE UP. Now, when I see and meet guys the first few times, I can see myself with them. I’m really interested, they start to show signs that they like me, and I just get irritated with all the affection and attention, and I hate that I’m like that. I just don’t know to be affection or anything either because my EX was not affection, attentive or showed he wanted me. I really like this guy I am seeing but I’m at the point where I don’t want to lose interest in him, but I want to say “can you act like you don’t like me so much”. It’s to the point where I am trying to find flaws, ugh. He says he really likes me but when he says that it draws me back and I feel awkward to even say anything back because I just don’t know. I think I’m scared because I have had a bf who said I was only affection when HE showed signs that he didn’t want to be around or didn’t want me on him, such as he will blow me off by pushing me back cause I pissed I’m off.

Someone please help