Fertility question...

Okay girls. So please no hate comments about what I'm about to ask. If a man smokes too much weed, but you dont, can this hinder your ability to conceive?