ladies help!!

Hello ladies! I don't usually post on here but I am having an actual problem. TMI just to be clear. Every couple weeks, I get these hard, painful, red bumps under my labia. Usually in a different spot but always my labia minora. I am not sexually active. They never have a head on them so I don't know if they are cysts that need draining. They come and go after a couple of days. Please help! Pretty painful this time.