Maybe I'm not doing it right

I can't seem to orgasm... It's a problem in sex and masturbation... And I've only had sex with 1 guy in the past 4 years like 4x... We don't anymore..... Shouldn't I orgasm easier since I don't have attention and I don't masturbate often?