He doesn't work?????

Okay ladies, My husband and I have been trying for a baby for over a year and I have had one miscarriage but other than that there hasn't been any progress. My husband swears it is him and not me and that he is not fertile. I guess I just need someone to talk to. Anyone else have this issue where your husband feels like he doesn't work or any issues with conceiving? Please share your stories, I would love to hear them all.