engorged breasts 😫😫

I'm 5 days postpartum and my milk has just came in...I don't plan on breast feeding but my breasts are engorged and extremely painful to the touch! Any mommas out there know how to  relieve the pain and when the milk just goes away? TIA!