Condoms

When me and my boyfriend have had sex with condoms (we've done it without aswell because I'm on the pill) about 5 minutes in I start to feel really sore and I have no idea why! Does anyone else get this or know why it happens so I can prevent it cause it gets so sore that it really hurts and we have to stop and I'd like to be able to do it with condoms because the clean ups easier😂