Being judge for letting husband sleep on guest bedroom

When our son was born my husband took 3 weeks off work which it was wonderful he helped with the baby cleaning and he cook all meals ! Well now that he's back to work there's days he has to be up at 4:30 am to be at work at 5:30 and he doesn't get home until 5 pm so yes he needs he's rest and now my family its judging him for not helping at night and for me letting him get away with it , well first of all he only sleeps in the guest bedroom mon -Thursday on the weekends he sleeps with us and helps so I told my family to go mind their on fucking business and not come over anymore