Latex Allergy ?!

I develop severe UTIs after sex with condoms to be safe and my most recent partner suggested that maybe i am allergic to latex, so I looked up some articles and many women said they have issues with UTIs and found their mildly allergic to latex, could this be true? If so has anyone experienced it?