No sex??

I am 15 weeks pregnant, and while I didn't have much of a sex drive early on in my pregnancy (which I know is usually normal) most people say it comes back into the second trimester. Well I still have almost no desire ever to do it. I feel bad for my boyfriend:( Is anyone else going through this same thing? Help!