Help!!! Bf moms!

Hey yall. I am struggling right now with bf I am exclusively bf my son he is 4 months old. Just the last few days my right side is so full all the time it's painful. Even after my son feeds it is full again within an hour and so hard. It's sore on the side all the time. Any suggestions? I don't want to pump because I don't want it to produce more milk. Thanks for the advice in advance. :)♡