NEED ADVICE! (Long post)

So I recently started hanging out with this guy I matched with on tinder, but I already knew him through a mutual friend, he gave me his number and we started talking over a week ago. Since we already knew each other, our first time hanging out alone he came over and we just played cards and talked. He was here for hours, told me had a great time, hugged me goodbye, but it was so awkward when he left because he was like, reaching for a hug, then hesitated, but hugged me and left in kind of a rush. So then I texted him later thanking him for coming over and saying I had a great time too. He responded and said he’d like to see me again, so yesterday he asked to pick me up this morning to road trip to a big estate sale and to lunch. I agreed. He picked me up on time, got out and came to the door, opened the car door for me, total gentleman. We spent the whole day together, walked on the beach, went window shopping, he took me to lunch, and he would often touch me, not inappropriately but like, gently put his hands on my waist to move around me in the store isles, or to move me closer to him so he could hear me, things like that. So after we get back into town he came over to my house to watch a movie, and we were joking and talking at the beginning of the movie, he put his arm up over the couch so I scootched closer to him but he moved away and took his arm down. He put his arm up again for a min but was leaned away, and then took it down again. Within 15 min of that he said he had to go, awkwardly hugged me, and left. He texted me that he had a great time and wants to hang out again soon, but I feel like maybe he’s only looking for a friendship? I feel like it’s too early to ask him what his intentions are... I’m not necessarily looking for anything serious, I’m just confused by him and want to know if I did something that upset him or what.. any ideas on what his deal is lol I like him, completely enjoy my time with him, but I don’t get what happens during our goodbyes, it ruins the “date” for me.. any advice welcome

Update: he texted me most of the night while drinking with his friends, he would send me kissy faces, suggested some things we could do, (going shooting, camping, etc) and sent me a pic of a coke bottle he bought with my name on it to give to me. Well then I texted him this afternoon around 1 and asked how his day was going, and he never responded. I didn’t really care, I know people are busy, but he watched my Snapchat story and still hasn’t responded to my text. It’s not that I need to hear from him 24/7, but I’m just SO CONFUSED. #menthesedays lol