Please help! Mastitis? Clogged duct?

I stopped breast feeding about a month ago, and kept having problems in my right breast with what I assumed was a clogged duct. I massaged, applied heat, and it is just getting bigger and it is SO PAINFUL. There is redness around the area and there is a rock hard mass. You can actually see the mass from the outside, like my boob is shaped weird. I mentioned it to my doc at my postpartum visit and he said if it was mastitis there would be fever and flu like symptoms present. I’m not having any of that. But something isn’t right and I’m so tired of being in pain every day. Any advice???