Is it me or my husband at this point

I’ve been hesitant to post due to being unsure if anyone else has experienced what I am, but here goes nothing. TTC #2 with my husband for over a year. I’ve known of my PCOS since I was an early teen. I’m now 24. My first born is from another relationship and is now 4 y/o. Wasn’t trying with my first and was with her Dad for over 4 years and didn’t get pregnant until 3 years into that. I’ve recently been put on Letrozole 2.5mg and seemed to have ovulated and have been testing with clear blue opk. We’ve had unprotected sex for the entire year we’ve been trying. Now I’m concerned maybe it isn’t me and might be him....advice from anyone that has gone through this with their partner. During this hectic time we can’t even make an appt for him. 😩