Does he only want me for sex?

I’ve been talking to this guy for a few weeks and we’ve seen each other 2x since. Both occasions, we got intimate (not intercourse though) but when we were last together, we spent an hour just talking and holding hands before I went back to my place. Anyway, I wanna know... how do I know if he only wants me for sex? I’ve been saying no to having sex because I wanna see where it goes before going there. Btw, we are both 20 and I’m only in his city for the summer.