WEIRD QUESTION IM AN IDIOT

Me and my husband don’t use protection when we have sex. I’m allergic to latex, yes I know there’s other types of condoms but we don’t use them just out of personal preference. I am on BC. That’s not the question however. After we have sex I am itchy for a couple days-a week after. If he was cheating and using condoms with someone else would I get a reaction from latex being on him? Like if he was having sex with another woman with a condom, and then later with me without one would I still have a reaction?