Would you put family first in this situation?

Over the last few months, my family has caused me to have two miscarriages due to stress. My fiancee and I have been TTC for 8 months, two times we conceived successfully and both times my family got so pissed and treated me so badly (literally ambushing me and yelling at me for hours) that I miscarried both times. The first time I was 5w 3 days, the next time I was 9w 5 days. Anyway, (I cant make separate paragraphs for some reason) they decided that They were going to try to guilt trip me because I haven't gone to visit them since December, by saying I have the family loyalty of a cat. In this situation, would you go back to them ever again? Part of me never Wants to see them again. But part of me just wants to wait until I'm a few months pregnant So they can't Stress me into a Miscarriage again. What should I do?