What’s the deal with condoms?!

My SO and I have been having sex for 2+ years. I’m on the pill so we usually just go without condoms. We’ve bought them 2 or 3 times (more at the beginning when I was worried about the pill) and I got some yesterday to try again but they just don’t seem to work for us! I don’t get it because they obviously work for other people. Our friends talk about how such and such brand is great because it feels like nothings even there. But for us, it just like dulls everything. He doesn’t know if he’s inside me (he was literally just laying there with no reaction 😂) and for me it feels like rather than his dick inside me, it’s something much smaller like a grape 😂 and he’s not small! The condom didn’t seem too tight for him. It’s just annoying that it works for other people and not us. And we keep spending money on them. Does anyone have any idea what could help?