Milk supply

I had my son on Sunday and will be continuing to formula feed my milk has come in over night, does anyone know how can i dry my milk up and relieve the pain? How long does it take to dry up?