Recurring Yeast Infection?

Hey so I've been having this problem ever since becoming sexually active that while my boyfriend and I use condoms 99.9% of the time, the one time that we'll have sex without a condom it causes a yeast infection to flare up for both of us. We each have been prescribed creams from our doctors on a previous occasion since it's been happening so normally I just treat it topically and it goes away after about a week or so. But this happens literally every time we have sex without a condom and I'm lowkey a little worried about it.