Scared to have sex

I lost my virginity ages ago and have had sex a lot with the one guy I lost it to but it always hurt really bad and I didn’t know how to make it not.

Now I’ve been with my new bf a few months and we want to have sex but everytime we try all I can think about is how sore it was and I can’t get myself to go through with it. My bf is being so supportive and patient but it’s annoying me that I can’t be intimate with him when I really want to.

Any advice?