Piercing infection please help!!!!!

I put my cartilage piercing back in after a few years of having it out. It was obviously a bit of a struggle to get back in but it eventually went in. My ear went slightly red but I thought that was normal. The jewellery was a bit uncomfortable so I took it out.

After a while I realised my ear was really hot and red. It did pus a bit. But now I’ve seen that you shouldn’t take the jewellery out you should keep it in. But obviously I took it out yesterday before knowing it was possibly infected.

My question is should I put the jewellery back in?? Would it be better than leaving it out?