Allergic to condom?

I had sex for the first time today. We used a condom and everything. Now my vagina is burning. It hurts so bad I am in tears. I don't know what to do at this point. I know I'm not allergic to latex as I've been around latex balloons and latex gymnasiums and I have been fine. Any ideas? We did use a lubricant. A water based one. Fragrance free. Could it be that?