How often do you and your SO have sex?

So my husband seems to think we need a break. He says our sex life is going down hill ( keep in mind I found out I was pregnant 3 weeks ago ) my sex drive just hasn't been normal, I can't help it. I still give it to him like twice a week. But that's not good enough for him and it really hurts my feelings. I'm just not in the mood and I know it's because my hormones are changing. But be doesn't get that.