Not sure what it is? Help please.

I recently had acne due to my pregnancy. A few weeks back one of my pimples started to itch and turned into a cold sore so I thought. Now my face is finally clearing but all of sudden this other pimple started to itch again. I looked in the mirror and sure enough these little blister like bumps forming once again in a different part under my mouth. I don't think it's a cold sore and ever was to begin with. They aren't blister like bumps but more like tiny tiny puss filled bumps that ooze. I am wondering if it's a bacterial infection. Anyone have this before? Any relief and how to make it go away? I heard polysporin works. I really don't feel like going all the way back to the doctors to sit around for an hour. I just did this two days ago at my last appointment. At the time my face was clearing. Help please.