Boobs

My right nipple and small surrounding area is so extremely sensitive. I just had a baby a year and a half ago and now i am 16 weeks. I breast fed for about 3 months before I dried up. My boyfriend says it looks swollen and purple but doesnt seem abnormal to me other than its extremely painful. I rubbes it on my bra like 2 weeks ago and its been that way ever sense. If i had to rate the pain when it does hurt (not constantly but at least a few times a day) id say like a 7 or 8 compared to my other breast that mostly stays at a 3. Do you think its just normal or could it possibly be an infection or something? My doctor is rediculous and wont be able to get me in at all and my next appointment isnt until mid September.