Semen Allergy?

I always have sex with my boyfriend and it's all fine and dandy, but if he finishes inside me, my vagina is left all sore and semi-swollen. Could I maybe be allergic?