Smoker?

Anyone's husband an occasional smoker and still conceive? Husband is 38 and I'm 34. Ttc #1. He smokes occasionally and I've never touched the stuff. I heard it's really hard to conceive.