Nipple (lack of) sensitivity

So everyone seems to talk about how much they enjoy having their nipples kissed, sucked, licked, played with, etc during foreplay or sex.

I’ve always sort of wondered if there’s something wrong that I don’t even feel any sensation if my partner plays with me that way. Should I be worried if I don’t feel anything (as in, if I didn’t see it, I wouldn’t even know I was being touched) on/around my nipples?