Engorged nipple?

I have larger nipples, and every time I pump after I'm done pumping my nipples become engorged and swollen and sore to the point where I HATE pumping... is this normal or how do I fix this problem?