I need help! Sorry for the long post

So as some of you know my child has Down syndrome although it hasn’t been diagnosed yet but we think he does. So my family never really went to school and are extremely judgmental and they went through my baby’s bag and found some paper about him possibly having DS. Reason why I never told them was because there’s a little girl who they considered retarded and spoke so bad of her because she has downs so I wasn’t comfortable at least not until we were sure. So of course it’s a huge deal now and I explained it to them and my sister says my mom is crying and she’s diabetic that I shouldn’t do that. So I moved them from a 1 bedroom apartment into a house in the county which they love. Now they are threatening to leave because I told them I got you all jobs , gave you a better life and yet no one has ever said thank you. My husband when he gets mad tends to say things he doesn’t mean and so do I so we don’t take it personal and just get over it. One day he was drinking and I told him I was going upstairs with the baby because he was too drunk so he closed the door and said fine. My family assumed he kicked us out. My husband has done soooooo much for them and me and they hate him just because back when I was pregnant he asked them to help around the house so I didn’t have to do it all and they are saying he aaa treating them like slaves. So I’m going and getting my baby tomorrow and taking some time away. I work nights and when I leave the baby is sleeping and wakes up when I get home no feeding, he sleeps right through so it shouldn’t be much of a task for them to watch him specially since Dad and Mom no longer have to work but when I get home my mom expects me to stay up all day with the baby even if I have to work later that night again so she can basically enjoy her life. She’ll only take him for like 5 mins. So I said how fair is that I let u not Work and u can’t even help me out. So anyway now my whole family is against me saying I should leave my husband and that I’m not appreciative nor care about my mom since she’s diabetic. What would you do ? I’m I wrong I mean between hubby and I we have and still do so much for them and all they said was well then we will leave. I told them u guys argue it’s normal but if we do it’s like the end of the world for u guys. My sisters husband used to actually beat her and his brother tried raping me yet my mom and Dad treat them both super nice and basically told me to get over it but my husband is an issue? Do I let them go? Cut them off ? Ignore them ? By the way I’m expecting again and I haven’t told them nor do I want to right now but if I don’t they’ll blame me for this too. I know this is long and I typed this super fast since I couldn’t have the balls to tell hubby he was the main issue I didn’t want to hurt his feelings . Plz I would appreciate any advice right now.