Higher sex drive than boyfriend??

So my boyfriend and I have officially been dating for 3 months and things have been perfect and amazing. He's the best guy I've ever met. Yesterday we were having a conversation that led to us to joke about how I had a higher sex drive than him, he actually agreed with me, which lowkey surprised me because I wasn't expecting him to agree with me lol. But whatever.

So we kinda started getting into a discussion about us and our sex life and he said "look I'm sorry but it seems like all you want is sex and I've ever been the type to really prioritize it. I guess I just have other things that fill my mind and sex isn't there". Which I kinda felt shitty about and said that I was sorry for asking for it so much and that I'll stop being so persistent about it. (Keep in mind, when I say sex, I mean penetration. We'll have a lot of foreplay, but it seems that after that it kinda dies down.) He said not to apologize, I didn't do anything wrong, but I feel like I annoy him with asking him so much? Last (and first) time we had sex was in early July.

Has anyone else had this problem? Like, I feel stupid because I'm always the one initiating our sexy time and he never seems to start it. Which leads me to feeling veryyyyy self conscious. Like, did he not enjoy himself when we had sex? Is there something wrong with me that he's not sexually attracted to me? How can I go about this? This is the first actual issue and "argument" you can say, that we've had and I just need some advice on how to go about this.