Sex isn't fun, will it ever be?

After reading some of the 'I'm a certain age and here's my number' (nothing wrong with that, no judgement) I'm wondering something now.
I had vaginismus, which is a condition that makes the vaginal walls too tight for sex. So I physically couldn't have sex. My amazing husband waited for me, helped me figure out what was happening with my body and even helped me find a specialist who knew everything about my condition.
10 months later, one surgery down and weeks of vaginal training using glass tubes, we were finally able to do it.
I was a virgin before him and he was so happy to help me through all my issues, but my final issue now is that it's not enjoyable, always hurts like I'm being stretched every single time. It's been almost 3 years since we started having sex, and I give it up to him at least 3 or 4 times a week.
Now that I'm pregnant, will I start to loosen up and enjoy it more once the baby stretches me out?
I'd love to hear anyone else's struggle with vaginismus. Definitely something they don't teach you in sex ed.