Advice on taking medication while pregnant

So I suffer from anxiety and depression. I should say pretty sever anxiety. I have always been on medication my life. I stopped once and went back on them. (Sertaline) when I knew we were going to be starting to try for a family I took myself off of them. Qe tried for 3 months i got pregnant then had a missacarge. I had just started a new job (in August this happend) and my husband had been dealing with some buisness issues. I was very stressed, anxious and depressed. I go through it. We have been trying for 3 months now with no luck still. My anxiety is getting worse and I'm down about not getting pregnant. I have had 2 panic attacks at work and have had to leave. My relationship with hu husband is not doing good because of me. My primary care doctor said it's my anxiety and that I need to go back on medication but that I should not take it while pregnant. My obgyn says it's safe to tale during pregnancy. Now my primary doctor I have known since I was 14 years old. I trust him. My obgyn I have had for 2 years, not saying I dont trust her but I do have a lot of confidence in my primary doctor. He said according to research it's ok for women to take sertraline while pregnant but should be taken off during 3rd trimester. This makes no sense to me! But any how.... I didnt want to be on meds out of fear that it will harm the baby in some way or make it have a birth defect. (I should note my brothers autistic and I have fears of having a child that is autistic or down syndrome ect.) So I'm looking for advice. Has anyone on here taken sertraline (zoloft) while pregnant and had a normal pregnancy and baby? I should also mention I have been trying natural ways to deal with this. I have done reiki, meditation, deep breathing, yoga.. nothing seems to help. Any advice!?