Pimple?? HELP!!!!

About a month and a half ago this big pimple-like bump showed up on my neck and it was pretty painful. I squeezed it and most of the pus came out except for a little bit. It doesn't hurt anymore when I touch it and it has pretty much went down. But there is a little patch of skin where if I touch it it feels like there's a little ball underneath the skin or something. Does anybody know what this could be? Should I be worried? Will it go away? PLEASE HELP!!!