Newborn milk supply - should I breastfeed and pump?

Ann • First time momma to a baby girl born August 2016!
My baby is only 1 week old and I already have plenty of milk. Baby eats every 1-3 hours for about 10-15 mins on each breast. I still feel full after, so I started pumping the rest of the milk out and get about 60mL (2oz) each boob after I breastfeed. I do this 3-4 times a day. It's nice because at night I can bottle feed, or if we go out I can just take a bottle.
However I've heard this is bad practice because I am overproducing. I am starting to have extra per day so I'm having to freeze now. I don't go back to work for a while so I don't have a need to freeze quite yet.
Should I start weaning off the pump and exclusively breastfeed on the boob only? How can I do this? I don't want to overproduce and waste breastmilk.