Why does sex hurt for him?

Last night I slept with the guy i’m seeing for the first time. After 5-10 minutes he stopped because he felt “satisfied”. None of us had even had an orgasm, but he said that he didn’t have the energy for more. After a couple of minutes we started touching again, and whenever I was close to his penis he said that it hurt. He said that he’s never had sex for more than 15 minutes because it starts to hurt for him. Whenever we were trying to fit it in, he felt pain. Has anyone ever heard of this before? I’m not sure how to deal with it, and I think that we might not be sexually compatible.