Partner with an incurable STD

My partner and I unexpectedly got pregnant. He has HSV2 (genital herpes). I got tested, then we waited 8 weeks (while abstaining from sex) and I got tested again. Both came back negative. My doctor is telling me its ok to have sex, just to use condoms and take a daily pill during my last trimester... but it makes me nervous. Partner suggested avoiding intercourse completely until after the baby is born.

Does anyone have experience with this? Anyone know the risks? My doctor made the risks seem very small but of course the internet makes them seem catastrophic.

According to my doc 35% of people are never contagious except during an outbreak. Of the 65% who are, they're only contagious 10% of the time. And condoms reduce the risk. Also, I have HSV1 (oral herpes) and I'm being told I'm less likely to catch HSV2 because they're so similar that my antibodies from the HSV1 may fight it off. But we wouldn't be able to live with ourselves if something happened to the baby.

Just wondering if anyone had any advice or experience with this.