Feeling discouraged 😞

So I had my "discussion" appointment about the plans we would take to force my ovulation as I have PCOS and well my husband had a SA done with all aspects being normal, but his morphology came back at 2%. So my doc and I had this amazing conversation about putting me on Letrozole (sp?) and what it would do, the risks and other things I'd need done like testing my progesterone and after this amazing conversation thinking YES, maybe next year is finally our turn he asked if I had any other questions and I said I know he spoke to my husband about his results, but that I would also like to hear them from him and my doctor literally put his head down buried his head in his hand and was shaking his head and said he forgot all about that and that we need to see a fertility doctor. 😭😭😭😭