Ask if he's cheating?

I've been seeing this guy for a few weeks now, apparently he's been cheated on by his gf and doesn't want to get involved in a relationship right away so we're just fucking. Turns out, I strongly think that he might be the one doing the cheating...with me :/ I don't know how to approach this issue. Advice please! :(