Banning Visitors?

I’m 10 weeks from my due date! Finally! However I’m finishing up my birth plan and I’m considering not allowing visitors (other than my parents and my husbands grandma (she raised him)). His dad has just recently entered his life along with a stepmom and they are so awful and downright rude to my husband and I. We do not want that type of negativity surrounding our little ones birth. His stepmom is even going as far as trying to get me to allow her in the delivery room! Not gonna happen! Is it selfish of me to ban them from coming to the hospital? My husband doesn’t even want them to know when we go into labor.