Am I wrong?

So yesterday we went to visit my SO family, aunt, cousin, and then to visit his mom and sister. I understand they are very excited about baby. But they want us to let them know the moment we are going to the hospital so they can go too. And Kept saying they are gonna be there all the time because They are so excited and blah, blah. But I'm thinking I want to have my time with the baby and hubby. Plus, it's so uncomfortable when people visit at the hospital, everything hurts, ur almost naked, the nurses come to check on you constantly. Idk what to do. I told my so today and he kinda got upset. It's his first baby.