Pushing?

First time mom, due December. Just wondering exactly how you’re supposed to push out the baby? Do you just push like you’re pooping or what? What if you have an epidural? How do you even know if you’re pushing if you can’t feel anything?