weed... and pregnancy?

Just wondering what the deal is if your man gets you pregnant when he's a weed smoker... I don't smoke myself but he's been doing it for years.. It won't affect the baby through his sperm will it??