Trying to change

My husband and I have been ttc for five years. My periods are regular. I’ve seen many drs to find why we’ve been unsuccessful. They said there isn’t anything they can find that’s causing us to not get pregnant. We have had two miscarriages- around the same time I went on a diet. Twice I went on a strict gluten free, sugar free, vegan diet in anticipation of family weddings. Both times I found out I was pregnant at the end of the month. Both times a week later I miscarried. That diet is something I can commit to long term— maybe not the vegan part but I can try. Has anyone else noticed food being a contributing factor to they’re fertility? I’m just wondering if they saw an allergy specialist to help them or something. Any one else thinking diet is part of their fertility struggles?