Fantasizing about my partner?

Am I literally the only person who tends not to think about my partner when I masturbate? It's not that I think about anyone else specifically, but i just don't typically think about having sex with him. I'm not sure why that is.