New mom and I need advice/help!

First time mom. 2 day old baby.

I have inverted nipples and baby was getting so frustrated nursing and latching on so I decided to give him some formula and pump my colostrum to help him eat. I feel that introducing the artificial nipples helped him latch better so now breastfeeding isn't as difficult for him. But now my breasts are so engorged! Do I continue to pump and just freeze it or how do I get it so my breasts don't make as much milk??