But I get these annoying bumps on my forehead by my hairline quite often (not in my hairline, still on my actual forehead). I never had an issue when I was on BC so this is quite new and annoying for me.

They aren't pimples, they aren't blackheads nor are they whiteheads. They don't come to a head, they just rise up and go back down.

How do I treat this? I'm using an exfoliator twice a week, an acne specific face wash and a nice light aloe based cream. I use tea tree oil when needed.