Advice on stopping to nurse my 4 day old..

Hello. I have a 4 day old.. we had been nursing but became way too painful. Now I’ve been pumping and it is taking a toll on our family. I have a wild 2 year old to wrangle and I’m finding it to be too much. Please no judgment, this is what’s best for our family. My milk has come in and I’m engourged really bad. I’m in a lot of pain.. I’m pumping just enough to provide a small amount of relief. I’ve pumped 3 times today.. I feel like I keep getting more and and more every time. How do I dry up my supply without getting clogged ducts or an infection? Thanks!