Hubby has low motility

Background: Got pregnant last Jan wirh my now hubby bit it was ectopic. It was a heck of a roller coaster bc they had a hard time figuring it out since my levels were nearly doubling but couldn’t find any thing on ultrasounds. Eventually it was confirmed, treated with Max shot and I was considered not pregnant by end of April. We have been trying ever since with no luck. I had an HSG which showed my tubes were clear and blood test showed I ovulate and progesterone levels were awesome so we got hubby a semen analysis and he has great count but motility is low and there are abnormal sperm.

Dr recommended meeting with a fertility specialist which we are going to do but has anyone else dealt with this?

I have 3 boys and he has 2 girls from previous marriages but his ex had a late miscarriage and we had the ectopic and I wonder if his motility is the reason...

After the surprise last Jan we decided we really want one together.