TTC #1 at 35...feel like I waited to long

Hey all, just hearing up to start trying for #1 for real this time and my anxiety has been through the roof. I had an HSG done about a year and a half ago-tubes are open. Had bloodwork done last year and hormone levels were all normal, AMH was 2.6. Despite it being likely that I'm fine, I can't help worrying that I left things too late and that it's not going to happen for us. My SO has issues with ED and he can't always ejaculate when I need him too. This makes the stress even worse. I see so many horror stories on here about people trying for years and years with no luck and I'm terrified I'll be one of them.

SO is 40 and I'm 35. Just wondering...those of you who are 35+, how long did it take you to get pregnant? I know it's different for everyone but the pessimist in me says it might not happen at all thanks to my age 😩. I'm getting more bloodwork done in 2 weeks just to make sure there aren't any surprises. It doesnt help either that both of my good friends are pregnant right now with #2 and they're both due in the same month 😔.