Not Wanting Visitors (right away at least)

My husband and I are expecting our first child, and we both come from very mixed families. Between the two of us we have 4 moms, 3 dads, lots of brothers and sisters and grandparents and extended family that are close to us. I have already decided I do not want anyone in the room when I deliver besides my husband and a birth photographer. But after the baby is here I am really wanting to wait a day before any of our family comes to see the baby. I almost don't even want to tell anyone when I go into labor. To me, I want my husband and I to be able to spend that time bonding with our baby and getting much needed rest. The thought of all of our family barging in just seems overwhelming to me. Is that not a fair thing to ask of my family?