Allergic to Condoms?

I keep having a rash appear on my face every time my man and I have sex. We only use latex condoms for protection.

Does anyone have any advice as to how I can fix this problem? Xxx