Chronic illness and pregnancy

I'm 26 and I was diagnosed with Lupus almost 7 years ago. My husband and I have been working diligently with my doctors to have a safe and healthy pregnancy, but it seems like my family don't want to listen to the doctors and just want to hold my illness against me. I had a previous miscarriage before my diagnosis, and that gets thrown in my face, as well. Sometimes I swear the stress they are putting on me is what's going to make conception difficult.