Help!

My periods have always been 28 days... now there anywhere from 28-40 days apart. I wemt to drs yestrrday amd she wants me to go to a fertility dr. I'm ok woth that but we haven't been actively trying for 1 year yet.... October will be a year. I've been tracking and doing ovulation predictor tests and get surges, should I hold off for a couple more months or go now?! I don't know what to do, I know we're not interested in ivf or anything like that...Atleast at this point