Having troubles

Ok glow ladies... I had my daughter in 2010 and afterwards had the implanon put in my arm. I had it taken out in May of 2015. My husband and I decided we wanted to try and have a baby. I started out having regular periods. But now they are very irregular and often missing. My regular doctor has done blood work and an ultrasound and says things are fine. I am thinking it is time to see an obgyn but my husband thinks I just need time. What should I do?