Afraid to Orgasm??

I don't know what's wrong with me but every time I'm being fingered or given oral sex, I get freaked out when I start to feel out of control, and I am so overwhelmed I have to make him stop. It doesn't happen when I'm doing it to myself, and it's not that it doesn't feel good. Does anyone have any possible explanations for this?