I Need Female Advice.... Please Help

My fiance and I are 20 years old both of us, and we want to try for a baby. But I got my IUD removed in July 2018 and had two periods, but for 4 and 1/2 months I had no period whatsoever I was ovulating and everything no PCOS nothing like that, my family doctor, who I do not like for reasons. Told me that the Birth Control Pill will help regulate my cycle so I agreed to go on it for 6 months, but my fiance and I really want a baby right away, we have money saved up, and we are ready to be parents, but everyone we know except his dad and step mom are against us having a baby. And I just need advice. Should I stop The Pill right now and go on this supplement called Vitex that helps with a woman's irregular periods or stay on The Pill for the 6 months and hope I have a regular cycle.