Don’t know what to do

So me and my boyfriend got into a really big fight last night. We were having sex and when he put himself inside me I realized I hadn’t taken my birth control for the past two days. He did a couple of strokes before I had realized this. I had not taken my birth control because I have been extremely sick these past two days and have been so miserable and sick that I forgot. After my boyfriend got out he was really mad, which was understandable because this is a responsibility I have for the both of us. My boyfriend a couple years back was drunk and this crazy girl who had been obsessed with him slept with him to get money from him. However she had a miscarriage. So I understand how us being protected is really important and I felt bad that I had not done my responsibility. However, when I told him how sorry I was. He began comparing me to this crazy girl who wanted to get money from him. My boyfriend comes from a rich family and the fact that he thinks I am with him for his money is really hurtful to me and how he views our relationship. We just celebrated our third anniversary. He compared me to a crazy chick at a party when I am his girlfriend of 3 years and it makes me feel not respected. I told him this and he basically told me I was making this about what he said instead of what I didn’t do and calling me a stupid bitch. When he said this I put on my clothes. Which grabbed his attention asking me where I was going. I ignored him and left. I then stayed the night at my friends house and now it’s morning. He has texted me and called me saying how sorry his behavior was last night. Saying he had some drinks which made him yell at me about the birth control. But I know he had no alcohol in his system last night because he went to see his sister, niece and nephews. Which is annoying because he should just own up to what he said instead of blaming it on drinks. Also me having sex with him was a lot for me. Mind you I have been throwing up for the past two days ( I have cyclic vomiting syndrome). So that’s why I forgot to take my pill and just wanted to please him because we haven’t had sex since I’ve been sick. I know that was stupid, but I feel like he made me feel like shit and also our relationship. It was a honest mistake and that shouldn’t been targeted about why I’m with him.

*Btw we can’t use condoms because I am allergic to them

*since writing this post he has been texting me nonstop saying how sorry he is and that I need to come back home.