Should I trust that he has feelings for me?

So I’ve been sleeping with this dude on and off since the start of summer. We hung out and slept at each other places a few times so I started having feelings for him but I never actually told him straight up.

I did ask him the famous questions "what are we” ;

He usually would say I like you but we’ll see where things go. I once asked if it was just sex between us and he response was “clearly”. I distanced myself from him after that and only hit him up for the D appointment.

I recently told him that i don’t want to continue seeing him because I am dating someone that I want to take more serious. His reaction shocked me cause he got very frustrated and started telling how we felt about me. He also mentioned that he never told me that he liked me because I was acting like I only wanted sex from him.

He’s been texting and and calling often. Trying to arrange for us to meet, basically everything I wished he did when I started liking him.

I’m confused now because I’m not sure this is happening as a result of poor communication on both our parts or if he’s saying all this because he just doesn’t want me to move on?