Pumping and feeding-HELP

So while in the hospital, my daughter was great at latching but wouldn't stay on long enough to eat enough. So we were supplementing until my milk came in to pump. Well, my milk came in and I started pumping every feed, sometimes more to produce enough for her to eat while still attempting to breastfeed. She's now 9 days old and completely has the hang of breastfeeding. She doesn't eat every two hours anymore but my boobs are still used to the schedule and I'm now overproducing. How do I slow down my production so it's just for what she needs? She only feeds off one side per feeding, I don't want to continue to pump AND feed bc that just produces more.. but I'm in pain 😩 HELP.