CONFUSSEDDDD AF

I seriously honestly don't know. There's this guy & we met through a mutual friend. She set us up. From day one we were extremely hot & heavy with each other. Made out for hours & I sucked him off. We've done this at least 3 times & we ended having sex for a little bit before I cut things short because I mentally couldn't do it. He's very sweet & handsy with me during these moments. However it's before & after that I just don't understand. He becomes very nonchalant & doesn't give a fuck about anything or anyone. Like I like to cuddle, hold hands, etc but he always walks in front of me & doesn't even look at me when he talks to me . I don't know if he's ashamed of me or if he just isn't into the whole PDA thing or what. Can someone plleeasseeee explain this to me before I give into my urges of having sex with him again? Thank you