Switching Back to Breastfeeding after EPing

My son is a week and a half old and was unable to breastfeed for a week in the hospital so I had to start pumping to feed him.  I am pumping around 40-50oz per day already but I would like to try breastfeeding again now that we are home but I'm afraid that I will get engorged if he doesn't eat as much as I have been pumping.  If I switch is it going to be double the work to pump and breastfeed?  What would be the best way to go about trying to switch?