Pregnancy and antidepressants

I'm really really struggling at the moment and do not know what to do!!

Iv got 3 lovely little boys, 7,6&4, easy pregnancy with each of them and now I'm pregnant again I'm so scared!!

I had 2 miscarriages, one December 2016 (12 weeks) and one December 2015 (6weeks)...I am overall really healthy and like many couldn't understand why!?!!

The only difference with me is that I was on 50mg of sertraline antidepressants after having my boys and going through a lot of trauma in life and loss of my dad!!

Could the antidepressants be causing an issue for my pregnancy!! I have stopped taking them as I'm so worried but I'm so so stressed and feel like I can't cope with day to day life! I get really stressed over minor things!

I never thought anything of it until my partner pointed out that it was the only difference in our pregnancy. (Men and their thoughts, I know he meant no harm)

The midwife says it's the best one to b on but I can tell they don't like the fact!!

Anybody else been in this situation xx

Any help would be appreciated xx