Hairline acne

This is going to sound weird to some people but my skin is sensitive and for a while I’ve been having like acne around my hair line and at the very top of my back. I’ve been thinking it’s from like my shampoo and conditioner. I’ve changed products but it’s still there. It’s embarrassing especially when I am wearing a swim suit or I put my hair up.

Does anyone have any tips on what they use to prevent/treat this for themselves? I use rubbing alcohol but I don’t want to dry my skin out...

I also try to keep the conditioner off of my neck in the shower by putting my hair up and finding my conditioner out by flipping my head down..