husband won't have sex

So I am currently 6 weeks & 6 days pregnant. My husband doesn't have sex with me at all since we found out I was pregnant. I'm pretty sure there's a lot of people out there who are pregnant and do have sex. Is sex gonna hurt the baby? Or what is your opinion on this.