What should I do ?

I was in a relationship with this guy and during the relationship I would give up because I have anxiety and I fear that people will eventually leave me. Due to things that happened in my past. But me and him ended up having sex and I wasn’t planing on it because I was celibate for almost 2 years. I honestly feel like I’m broken because I can’t keep a relationship I feel like maybe something is wrong with me. I keep messaging and trying to get him to see my point of view because he seemed like the guy I wanted to spend forever with but he can’t see things the way that I do. How do I move on from him and move on from dating ? Because I just feel like something is wrong with me ?