TMI: I get these things on my breasts they never come to a head..

I get these bumps on my breasts from time to time.  They never come to a head and pop. They are sore when coming in then they just fade away. Should I be worried?