Would marijuana affect conceiving?

I was not the one smoking it, my boyfriend was, and we tried to conceive several times with no luck.  Could that be the cause of it ? Or is there a possibility he wasn't able to conceive with me?