Terrified to have sex

I had an ectopic a few months ago. My husband and I had sex and the next day I started bleeding bright red. It was absolutely traumatizing. Obviously an ectopic is when the baby grows outside the uterus so the sex didn’t cause the miscarriage, but the timing was horrible. I’m 5 weeks now and I feel so protective of this baby and I feel so bad for my husband who is waiting so patiently...you know men, you tell them a few days without it and they think they’re dying. My OB appointment is in3 weeks. The nurse told me I’m good and just enjoy being pregnant. Didn’t say pelvic bedrest or anything. This is my 4th pregnancy and I have 1 on earth so I feel dumb asking but sex is ok right?