Visitors after Birth?

What’s the nicest way to tell people you don’t want visitors when you get home from the hospital? Or how are you ladies who have already given birth dealing with this? My mother in law is coming to stay with us to help with the house and our dog but besides that I really only want my parents and my sisters and that’s it. This is our first child and I just don’t want a parade of people through my house when I’m literally wearing a diaper. I’m a very private person and I have severe anxiety about the whole thing already. We already told one brother in law that he had to wait three weeks and he threw a fit. I don’t know why everyone is so obsessed with holding the baby when it’s fresh and new. Besides the fact that it’s about to be flu season and the idea of 10 people a day playing “pass the baby” with my newborn son is horrifying to me.