Trust issues

I gave my boyfriend a second chance because I love him and thought I could work things out with him . At times I am having a good time with him but then the fear of him doing it again always consumes me. I gave up my virginity and he is also my first boyfriend . The first time we had sex we didnt use protection. My so called friend at that time bought me plan b , so I wouldnt get pregnant . I told my boyfriend and he said he would pay her back . I later gave her my bf number so they would come to an agreement and pay back the money. The day they decided to meet up , my boyfriend calls me and tells me they were going to meet up by his aunts . Later that night my friend texts me and says she has to tell me something . I had a bad gut feeling about it. At first she didnt want to tell me because she said it was better in person . I keep bothering her until she told me . She told me my bf jumped on her and couldnt get him off. I was so heartbroken. I texted him and broke it off. I blocked him from all social media and his calls , and messages . Funny thing is my friend didnt mention inviting him inside the house and she had also said she wasnt comfortable with him ......I talked to my bf and he said she wouldnt let him leave . I told him if he was being restrained or handcuffed . He said no . So i told him it was common sense to leave if he knew it was bad instead of staying with her. He could have given her the money and walked off. My question is , is my trust going to ruin the relationship and is it wrong for me to feel like this ?