Boob Pain!

I'm not pregnant but my boobs are getting bigger and hurt! They are so sore I won't even let my man touch them. I've never had this problem and today my fiancé looked at me and said "those are like milk ready boobs babe." I stared at him like oh my god you read my mind. I have a bacterial infection and yeast infection down in my vaginal region, could it have anything to do with that?!