Need advice ASAP

It's been two years since I had my son and just a bit less since I stopped breast feeding and yet I am still producing milk. Should I go to the doctor and see if it's something serious? It itches as if I'm still breast feeding and it stopped for a while. It started itching today. Please give me some advice.