labor plan

My husband and I were talking the other day on who we wanted there when I go to have our child. He wants both his mom and my mom there and I just want it to be him and I. I had my mom their for my first child with my ex and that was drama. I don't want to feel stressed at all. Yet the vibe I am getting from my husband is he wants them there so he doesn't have to be the one I lean on so much. Feels like he doesn't want to be just us like I told him I want. He gets kinda pissy about it and says I'm going to hurt their feelings if I don't have them there. But he's not thinking about how I feel at all. I just don't know what to do.