Fear of child birth - Is it normal during pregnancy?

Rabia • Expecting our first child! Extraverted mom, introvert dad. Baby? No idea! :D
I've just conceived and 9w into it. It's an unplanned one but I'm excited for the new addition. It's our first child. But, I'm really scared of child birth and labor. I stay on the 2nd floor and no elevator. Is it possible to still manage the pain while taking stairs? Or am I just worrying too much?