Guy too sensitive down there?

So I have had sex with a few guys but this guy was odd. He was very sensitive down there. Every time I would move differently or even grasp his penis, it hurt him. Has this happened to anyone else? It confused me and kinda worried me at the same time.