Milk blister! Help mamas!

✩M
So as the title suggests, I have a milk blister and it hurts! How do I get rid of it? I've been trying to make sure my son nurses on that side to try and dislodge it, but no luck yet.