Help VEGANS and VEGETARIANS !!

I've been TTC for a year, and no luck. I have two children from my past relationship they're 10 and 8, i haven't gotten pregnant since my 8 year old daughter. My husband and I have been trying for a year, we've been together for 2 years and half now. I don't want to seek any fertility treatment until I've tried everything I could naturally. We recently both changed our diets, I became vegan and he became vegetarian. I've been taking organic plant base prenatal pills, smoothies and Maca. I'm 31 and 137lbs, not overweight but possibly my age has something to do with my fertility? My period was due September 14th and I got it Thursday September 7th, I'm over here trying to get pregnant but ended up getting AF early! Did this happen to any of you diet changers out there?? My husband got really sad when I told him I had my period really early and said, " we're never going to have a baby 😞" which makes me sad because the one thing I can't give him is a baby. It's so frustrating...let me know if any of you had your period early while TTC when your diet changed, just need some reassurance 😭😭😭