Condom allergy?

This is embarrassing but I've only had sex 3 times ever...each time with latex condoms. I always get really itchy and red down there and was so scared that I caught some kind of std or something.. I'm not allergic to latex anywhere else on my body so i was shocked that you could even get a mild reaction from one specific area. I narrowed down to the thought that the condom was the main culprit..because it only felt that way specifically inside the "canal" I guess where the penetration happens. I didn't get an allergy test though because the last time I was at my doctors I felt very rushed and like I didn't get many questions answered..