Sex problems?

So I’m writing this anonymously because I know some people from my town on here and honestly this isn’t something I want them knowing about me. Here it goes, my SO and I have been together for 5 years and have been married 7 months. Sex has always been hard for me even with past sexual encounters, because I just don’t have the drive, I like to do it on my own terms. Well I’ve recently become pregnant and am now going on 15 weeks. My sex drive is very low but sometimes I get a wind and want it. Well with my husband we’ve always had little arguments where he doesn’t feel like I put out basically. And I admit in the past I’ve gone months without having sex with him but I’ve been really trying to change. For the first few weeks of my pregnancy I wasn’t doing sex at all, I just didn’t want it, then I got a little better and we started doing it once or twice a week, I felt like I was doing really good. Well yesterday my SO came home from work and wanted to get it on, I wasn’t feeling it. So I told him not right now how about we do it when we go to bed tonight? He then got very quiet and wouldn’t hardly talk to me. This is how he’s acted in the past when he didn’t get sex so I knew where this was all going. I tried asking him about it and he said he was fine, I finally got pissed off to the point where I asked him again and he told me, “ I was hoping we could have sex on my terms tonight” ladies I’m seriously feeling like I’ve let him down. Sometimes I feel like the sex I give him isn’t enough🤷🏻‍♀️ I started crying because I just felt bad but didn’t know what to do. He is a damn good man, I love him so much but should I really be having this hard of time with him about sex? I feel like I’m giving him enough but honestly I just feel a little pressured. Any advice would be appreciated!