Orgasm trouble!

Is it normal for me to not have an orgasm with my boyfriend? I feel so bad that he tries so hard and yet i can't orgasm. Although, when i masturbate i can do it myself, but for some reason i can't when we have sex or he goes down on me. Does anyone else have this problem? How do you fix it?