Any ladies experience problems conceiving after Gastric Bypass/Sleeve?

I am 4 years post op and due to some poor lifestyle choices I stopped taking my bariatric vitamins for about 3 years. I was basically told I flunked my blood test... I am now anemic. I haven't had the conversation with my doctor yet of whether this can cause temporary fertility yet because I already have a womens wellness visit scheduled with the Gynecologist in July. I have since been on vitamins daily and begun my b12 injections. I know there are connections to anemia and infertility so I was just curious if anyone else had a similar situation and if there was success in conceiving after treatment!