Sex while pregnant?

Serrania

My husband has a really high sex drive. He says he can't help it, I smell so so good and he can't get enough of me especially now that we are pregnant. But I have an admittedly low... almost nonexistent sex drive. And we've had a few scares about miscarriages and bleeding and cramping. He says sex won't hurt the baby but I'm afraid it will hurt both the baby and I, my cervix is low, I can feel it when I check with my finger. I just dont want to cause bleeding again when we aren't out of the danger zone for miscarriage. Should I stop being so worried? Is it an unfounded fear?