I like him but a HUGE turn off

I am messing around with this friend of mine and we both definitely like each other. We’ve have many “intimate times” if you know what I mean. But he has a smell, like idk what it is. It’s sharp and just not pleasant. Plus he’s way to sensitive, like me when I was younger and took everything literally. Also way to intimate, like not every thing has to be a kiss or has to be sex even though we can just chill ya know? We don’t want anything serious cause I don’t wanna be held back but I don’t know how to call this off, any advice?