Swelling because of semen?!

The other day things between my partner and I got intimate and we didn't have penetrative sex but his semen got on my vaginal area. My inner labia swelled up and felt irritated for a few minutes. The swelling stayed though. I'm wondering if I could be allergic to a new medication he started taking or something that was in his body recently. I have also read that you can develop a semen allergy. We have had sex before and it had never happened before this. Since it has gotten better I would just like to know what caused it