Pain with condom?

So I’m on birth control for the past two months. my partner and I have sex unprotected all the time which I know is bad. The other day I forgot to take the pill so I told him to use a condom for safe precautions. So we started having sex and I started to get really bad pain like I never had this pain before. I know I was wet so I wasn’t dry. So my conclusion was the condom which we took off and tried and I didn’t have pain after. Has anyone had pain with a condom when they haven’t used it for a while? I wasn’t sure if it was just me or if it was common.