right to be upset or am I wrong

I'm getting so frustrated with people and I don't know if it's just hormones or what but I need to just get some advice. 
So me and my son can easily spend a full week in the house and not leave once he's 7 and a half months old and I'm 6 months pregnant with  really bad anxiety and spd so we don't leave the house at all alone. He's a very happy little boy and I personally think I take really good care of him we play all day he's reaching all his milestones and more and he has slept through since he was 5 weeks old. He eats great and is a lovely weight even though he is quite a small boy it's kind of expected because I'm only 5'1 and a size 8 when not pregnant and his dad is 6'2 and very slim but was always a small child. Anyway my mil and other family and even a friend or 2 have had a go at me telling me I need to be a better mum and get him out of the house more. As if I don't already feel bad enough that I can't do that but anyway they say he's too isolated and he will grow up socially awkward like me. So at weekends when my OH is home we get out as much as I'm physically able I even over push myself and cause myself pain to make sure everyone is happy and he's having a good time but now I'm also wrong for doing that. I might hurt the little girl I'm carrying (there have been no girls born on my OH side for 6 generations so there very protective) and if I'm not hurting her I'm been a bad mum because I'm keeping him out too late. We staid out until 8pm ish on Saturday and at 7.30 ish my mil works at the family pub social club we were at and came over calling me a bad mum and he should be at home in bed. When I tried explaining he had a late nap and I knew he wouldn't go to sleep until 9ish anyway so it wouldn't hurt this once she said she didn't care and I needed to rethink my priorities and put him first instead of socialiseing. Yet she's normally having a go because he's always home. 
I feel like I can't enjoy any part of my life anymore if I try then I'm a bad mum. My son has stayed over night at grandparents houses maybe 4 times total but if I ask anyone to help just for an hour it's like I'm this horrible mother that doesn't love him. 
Am I wrong to be upset? Is it just hormones or are people in my life just bent on driving me insane? 
Sorry for the long rant x