I can't get myself off?

I feel something is wrong with me because I'm only 20. There will be rare days where I can orgasm but otherwise it could probably take an hour or more and I don't have patience for that. None of my partners in the past have been able to, and even while fingering and stimulating the clit it took me about 25-30 min. So embarrassing. Why am I not sensitive down there? I don't want to have to use toys or try so hard, I want to feel turned on and be able to enjoy myself. And of course the goal isn't to finish, but it would be nice :/