Visitors at hospital

Ok so as my due date slowly approaches I am very on edge about visitors. With my first everybody and there mama was there. I told hubby only me and him in delivery room. Our parents can wait outside. And the days postpartum his family was there from sun up to sun down. It caused a big fight. Should we make out a schedule and time slots for family? I would like alone time with baby and hubby. And then also time to look and feel decent before people come.