Sex smell

So there's usually a smell of sex when we do it but whenever we use a condom it is terrible. Can I be allergic to it?