can’t have sex?

i’m not a virgin, but i lost it at age 21. I’m 24 going on 25 now and have not done anything since. (i am asexual but not sex repulsed- i’m indifferent). When i lost it i was with my ex (bad awful 3 year relationship). Now i’m with my current bf and it’s only been over a month since we’ve been together. We tried doing it but it felt like a barrier he’d hit and i’m confused bc i remember feeling something break and then i could “do it” with my ex. I know the hymen can’t grow back but he said it feels like i’m a virgin. Could this be vaginismus ? i’m seeing gyno this week.