My husband smokes

My husband smokes weed everyday multiple times a day. He says he’s “cut back” since we’ve been TTC. I’m so skeptical about the whole thing and he’s defensive when I bring it up and doesn’t want me to assume it’s him the reason we haven’t gotten pregnant yet. Advice?