Tampon trouble

Is it normal for you to hurt when taking a tampon out? It doesn't happen often but sometimes it really hurts to take it out.