Why can't I orgasm from penetration?

Is it just me? I've only orgasmed through clit stimulation. I love penetration, like loooove it, but I've never been able to orgasm when my SO penetrates me. We've had lots of orgasms when there's clit stimulation though. Is there something wrong with me?