Acne down there

Am I the only one who gets acne in my lower region? It doesn't happen often but when it does it's only one or two and they show up suddenly and hurts pretty badly. Should I be worried?