3 Months of Trying...Nothing Yet...in my early 30s

Boyfriend and I have been trying for 3 months...not sure if we are not having enough sex, but I do attempt to have intercourse leading up to the days of ovulation... each month, I confirm ovulation with ClearBlue testing...my boyfriend does smoke marijuana though (he recently quit), so not sure if that's causing our issues....I have a normal cycle and I'm also within a normal BMI range...also taking my prenatal multis as well...I have an appt. w/ a fertility specialist next month...I understand you should wait 6 months minimum to see a doc., but why wait??? Anyone else have a similar story?