Sex and Yeast Infections???

So i'm at college and i live on residence, so my boyfriend will come up to visit every two weeks, and we'll have sex a couple times a day. When we use condoms, we use the Magnum XL and every time we have sex with a condom over the weekend, a few days later i get what seems like a yeast infection that lasts a few days? Does anyone know if i'm actaully getting reoccuring infections or if it could it be an allergic reaction to the latex?