Is this wrong?

I’m in a committed relationship, I adore my partner, he’s the best thing to happen to me in a long time - however, sometimes when I’m masturbating I can’t finish unless I think about his roommate, but I can’t understand why?