Allergic or?

Hey y’all I have a question.

So my fiancé and I have been having sex for a few years and up until recently we used condoms every single time.

However, we do not have sex often because we are on opposite schedules, sometimes we go two months without due to this. When we did have sex it would be kind of painful for me. We used lube always and made sure I was wet, but sex would burn and feel just uncomfortable. I’ve talked to my gynecologist about this and she just said it was where we don’t have sex often and that maybe I should see a physical therapist. I haven’t had time to see one yet, so oh well.

But, we have had sex twice without a condom now (a couple months apart) and there was no burning and virtually no pain during (slight discomfort afterwards). It kind of just happened and we didn’t use lube either time but had no issues at all.

So now I’m just wondering is this what a latex allergy can feel like? Or maybe the lube? I’m super confused about it. Can anyone with either of these allergies please provide some insight as to whether my issues sound similar?

Thank you!