New guy! First date

Alright so I need advice. Yesterday I went to go hang out with a new guy I've been talking to.  but plans got changed and ended up just haveing my older sister drive us around all night. We were in the back seat listening to music And just messing with each other. We ended up kissing which led to makeing out after that we had my sister take him home and he got me to go in his house. Ended up that he took me to his room we were kissing and he picked me up and put me on his bed he was on top and I was on bottom and he had me super super tight in his arms and it got where he took my pants off. So when he did that I freaked out and we ended up stopping and he kept apologizing and telling me he messed up I told him that he didn't and it was just I had just got out of a relationship and I thought he was moving to fast.... How do I tell if he really does like me or just trying to get in my pants? He seemed pretty upset after that happened and grabbed my hand and told me he didn't wanna just lose me and gave me all these really tight hugs.