Getting rid of ingrown hairs

I stopped shaving for a few months now due to ingrown hairs. I still have a few and I'm just wondering how do I get them to go away?