Family is upset they can’t see baby until a week after birth

My husband and I have both agreed that we don’t want anyone else in the room when I give birth and we don’t want any visitors until a week after birth. This is our first kid and we want time to adjust and get our dog adjusted as well before having to smile in a bunch of people’s faces. Both of our families are calling us selfish and saying it’s rude that they won’t be able to see the baby so long after he’s born. My husband and I don’t care but now we’re talking about if we should just not even tell anyone we’re in labor, do you think that will piss them off more?