Does weed affect pregnancy?

I am 18 years old and me and my hubby want to have a baby. we are both heavy pot smokers. ive been told that smoking weed can affect fertility when ttc and can harm the baby after you get pregnant even if you stop once you get a BFP. Is this true? I would never smoke while pregnant because it scares me but is it harmful while trying?