Stoner Partner and TTC?

Ok my husband isn’t a stoner per se, but starting somewhat recently, he smokes weed every night, and sometimes in the morning and afternoon lol. He’s super active and has a ton of energy and the weed is good for helping him relax.

I totally support it and sometimes partake myself, but I’m worried that it’s interfering with TTC. I’m ovulating now and the last two nights we had sex, his semen was like a minuscule amount.

Do you have a partner who smokes weed and you were able to conceive easily? Or do you think it’s interfering. If he can’t smoke he will probably be more stressed which I’m guessing will interfere too, so I’m not really sure what to do.