Zoloft while pregnant

I’m looking for some feedback. I plan to call my dr tomorrow but wanted to see what others thought. Before becoming pregnant, I was taking 50mg of Zoloft once a day for anxiety, panic attacks and depression. After finding out I was pregnant, I thought it would be a good idea to wean myself off of it. Even though my drs said that zoloft is safe during pregnancy. I just felt paranoid about taking it. I was afraid to take any risks. That being said, i weaned from 50 to 25 to none. I’ve been off of it for about 2 weeks now. I’m 11 weeks pregnant and my anxiety and panic has come back in full swing..moments of depression are appearing as well.. I’ve come to realize that maybe being off of it is a bad idea.. especially because my hormones are going crazy as it is. Being on 50mg completely helped but I am thinking about just going back to 25mg a day. Has anyone had experience with starting Zoloft (whether starting back up or just starting it) during pregnancy? I’m terrified I’m going to cause some kind of harm to the baby. I just feel like having my anxiety etc all back may cause more harm than the medicine at this point because my stress levels are risen.