Soooo Frustrated

So I had the HSG last week & they said women are more likely to get pregnant the month after and HSG. Just my luck DH had a Damon fever all week & we only bd once. Had another appointment today & she didn't see an egg so said I probably ovulated yesterday. I'm so mad we, by we I mean DH, ruined a very good chance to be pregnant without me having to go on meds or go through procedures. I kind of flipped earlier & told him that I feel alone in this. I think I made him feel like shot but it brought the point home. Urgh..... I'm so upset & my Dr made it sound like if we would've bd there would've been a very good chance to be pregnant. I hate this! Next step is starting Letrozol next cycle.