How often do you have sex?

During my first trimester, I never wanted to have sex with my husband because of how sick I was the entire time. I assured him one the sickness wore off things would get better. Now that I'm 25 weeks and feeling better physically, I still don't have that urge to be intimate because of my hormones. It's like everything he does pisses me off. I can tell it's affecting our relationship and I'm not sure what to do about it. And it doesn't help that when we do have sex, it hurts.