What’s wrong with me

My boyfriend and I have been together for 4 years and he has expressed to me that it seems like I’m not sexually attracted to him. I’m 23 and literally have a nonexistent sex drive and it doesn’t help that I get BV like clock work. I started taking pills to help boost my sex drive but stopped when I found out I was pregnant (had a miscarriage). He asked me if I ever just fantasize having sex with him or just doing stuff with him. I answered honestly I don’t really have those fantasies if I do they are rare I get Horny at times but if we don’t do it right then it just goes away. I told him I enjoy when we have sex it’s great for some reason it’s just the getting started part for me and idk why. Well he goes on to tell me that’s not normal and I should be sexually addicted to him like he is to me. It’s 5 am we talked about this for at least an hour. Well now he is on the verge of wanting to break up and is upset because I didn’t ask him if he was ok after the conversation. Literally we had just spent so much time talking about it I figured maybe he wanted to leave it alone. Am I wrong in this situation? Should I fantasize about him is this not normal?