Should I ask him to get a sperm count test?

OK so my hubby (46) and I (38) have decided to try and get pregnant. I've only been off my birth control for about 4 months. while discussing getting pregnant he made the comment "I'm not sure if I can get you pregnant I haven't gotten anyone pregnant in 25 years" (got girlfriend pregnant when he was younger but she decided on abortion) I asked has he and his and any of his ex girlfriends in past ever tried to get pregnant ever and he said no. Anyway, we've been trying since I stopped my birth control and still haven't gotten pregnant. So I'm kind of stressing now. I want to try and get pregnant before I'm 40! Any advice?