Is marijuana a problem when conceiving

I've heard that smoking is a problem when your trying conceiving. Lowers your Soren count or what we but I know plenty guys who has kids and smokes way more than my husband does. Also is it a problem with the female as well?