Male infertility

Does anyone know anything about male infertility brought on by mumps?
​My husband had the mumps when he was around 10, and I'm beginning to wonder if that is why we may be having trouble concieving.
​Would having the mumps totally mean there is no way to conceive naturally, or is there something he can do to maybe boost his fertility?