Can't orgasm

I've only had orgasms with oral sex but I never orgasm while having sex, is that normal?? I feel like I dont want to have sex with my boyfriend anymore because I don't want to fake it, but I don't want him to think it's his fault if I don't ! Any advice?