New to sore boobs

I am 26, have two children. I breastfed both. Lately my boobs have started hurting a week or so before my period and leaking. They constantly feel like I’m having a letdown as if I were nursing, but it has been almost two years since I have breastfed. I found a knot under my left nipple and the whole breast is super firm compared to the right breast. Both are leaking. The left side milk colored and the right clear. Is this common? It really hurts and radiates down to my armpit. Also having a headache every day since they started hurting. Any help or similar stories would be appreciated! 😊