Body & Mind Not in Sync During Sex

Hey guys. So I think I have a problem of sorts. I'm a very sexual person, in a way. When it comes to sex, it starts in my mind & I am so very turned on. But the moment my partner comes in contact with my body or tries to touch me, I dry up. And it has always been like this. Even when dry, I am turned on, but it just seems like they my body & mind are on two different pages. I don't masturbate, it is weird to me & I don't find it much of a turn on. I enjoy sexual activities very much, but they are just never in agreement. I'm beginning to think it's some kind of dysfunction or something... I really don't know. Help.