Nipples Feel Like They Are On Fire!

So I wear bras 24/7 (except for showering and sex). Yes I know studies have shown this to be bad and all, but I just love my bras. They are comfortable and keep things in place even though I’m only a B cup. Without bras I feel insecure, uncomfortable and unsightly. Today I decided to try going without a bra with a shirt on and my nipples burned sooooo bad. Every graze my T-shirt made over my chest was like sandpaper. Is this just because of wearing a bra all the time or should I be concerned??? Am I the only one who can’t go without a bra???