Sexually frustrated!

So I am almost 14 weeks pregnant. My doctor has said we are ok to have sex since going off progesterone. I have tried a few times to instigate sex with my husband. But he doesn't want to do it.

I mean I get where he is coming from. Last summer we got pregnant. We had sex and then two days later we lost the baby. I have told (and the doctor) him multiple times we didn't loose the baby because we had sex. There was something developmentally wrong with that baby, I can tell by comparing sonos from last time and this time.

I'm just frustrated because he won't listen to me or the doctors or anyone. And I don't know what else to do. I have tried talking to him about this but he refuses to listen. His response everytime is "you don't KNOW that it didn't cause it" and then he usually follows it up with some form of "I am the one who had to deal with you after you lost the baby"