Fear that husband has fertility issues

Does anyone else have this fear? We’re going on our 5th month trying. My cycles are like clockwork and I ovulate each month (confirmed by OPKs and temp). Husband thinks it’s too early to get tested and it’s just a matter of timing. Am I being ridiculous for having this fear already? He has plenty of semen when we have sex, just wish that was an indication of good sperm count, motility, etc. 😐 Has anyone had this fear but confirmed that all is well via testing?