Weed and TTC

Someone. Anyone. For the love of God please ease my mind. Has anyone gotten pregnant while their SO was an avid pot smoker? My SO has stopped smoking since August and we haven’t gotten pregnant yet. However the doc said it would take up to 3 months for his body to get back to normal and I just went back on femara (that’s the only way I will ovulate). So we’ve really only had 2 months of TTC without anything in the way. Now all of the sudden he wants to start smoking again. When he said it my heart literally shattered. Advice, kind words. Anything because right now I’d love to just drive away and never come back.

Edit: I guess I should include too my SO only has one testicle. Doctor said that it doesn’t affect anything but it’s so hard to trust that when we’ve been TTC for almost 2 years now and nothing. I also have endometriosis.