Herpes & infertility

I have 3 babies (5preg total) & Dh has none.

He has genital herpes. He also ttc w his ex for 10 years & not a single pregnancy.

His sperm count was ok after a 3 day hold, but towards the lower end of range.

Could that cause problems w us getting pregnant? The drs can’t figure out what our problem is.