Should there be a reason why I like having sex with one person?

The guy I’m with keeps on asking me why I like to have sex with him. I tell him I just like being close and being intimate with him but that’s not enough. I don’t orgasm when I’m with him but no one has ever made me orgasm. I guess I just don’t like sex as much as him. What are reasons you guys like having sex with one specific person?