Old nipple piercings

Hey everyone! Im asking this question because ive done a fair amount of research on this topic but couldn’t find any answers online.

I wanted to know if this has happened to anyone else. I got my nipples pierced in 2015 and took them out in 2019. When i got them pierced they healed very well and same as when i removed them. I had no problems what so ever.

Now keep in mind that i have flat nipples. My right nipple will sometimes harden up and i will feel something underneath the skin where the opening of the piercing would be. When i squeeze it, a lot of smelly white pus comes out. I dont see any signs of infection( no redness, itchiness, tenderness, etc.) and i usually squeeze it about once a month maybe.

Does anyone know what this could be? Can i ask my gyno about this or this is more a pcp type of question?