Smoking and TTC

I've been trying to conceive for a year now and starting to think something is wrong with or my man but he has two kids already..however he does smoke heavily now . Could this be the reason why I'm not pregnant yet? Is it because he smoke too much?