Depression/anxiety meds and TTC

Does anyone with mental health issues take less or stopped taking pills due to TTC? I am on Prozac for mild depression and high anxiety. I stopped taking them because I worry maybe they're the reason I having been trying over a year. On the other hand, I worry my anxiety is causing the same problems and the depressed feelings I get from all of it makes me know that I need to be taking my pills. I haven't been able to meet with my doctor yet. Anyone relate? Or anyone get pregnant regardless of anxiety?