Am I completely alone?

Emily
My husband and I are TTC. In the past, when we've talked about the birth of our child, I've said that I'm not sure who I might want to be with me in the delivery room and he's joked about being down at the bar smoking cigars like they did in the 50s. But I am not joking when I say I'm not sure if I want him present.
I know that I may feel differently when I am in labor, but I want him to accept that there is a possibility that I may not want him in the delivery room. 
Does anyone else feel conflicted about their husband being in the delivery room?