Being vegan has given me food anxiety

Let me start off by saying I love being vegan and I'm so happy that I opened my eyes to the reality of it all. I was a vegetarian for a while and looking back on photos that's when my body looked it's healthiest. It's never been easy for me to gain weight, but living at my cousin's I ate a lot (healthy and junk food) Now two years later I feel like I stress too much about not eating junk food, and eating primarily plant based, I avoid meat substitutes most of the time. I had a baby 3 months ago and have lost in my opinion too much weight. We're gonna start meal prepping so hopefully that helps me some. On the other end of things, I don't have the opportunity to work out quite yet. So I also worry about gaining weight in the wrong areas. I would probably be vegetarian if I was not lactose in tolerant.

Does anyone else overly stress about veganism and their diet?