SOS! What do I do now!!!!

I’ve been hooking up/talking to this dude for almost 2 months now. I’ve hung out with him literally any chance I’ve gotten. He’s introduced me to his friends and what not. Last night we went out with some of his friends for drinks and went back to his car. We sat in there talking and what not. We ended up having sex and he came in me. That’s only the second time he’s done that. But right after he told me he needs to stop doing that because he’s getting to comfortable, and the only way to do that is to stop having sex with me for a while. As he was saying this he was laughing but in my head I was like “wtf”. I asked him if he was serious and he said yeah. So then I started to get confused and asked him if he just didn’t want to hang out anymore and he said he never said that. Idk why but I mentioned that he just wanted to have sex with me and that’s it. And he told me if that was the case he would’ve only had sex with me once or twice then dip. It got to the point where we were sort of arguing and he just wanted me to leave because it was also late too. I could tell he was clearly upset. I texted him this morning saying I was sorry but he never replied. I ended up calling him bc I thought I left something in his car. I ended up saying I’m sorry over the phone and that I still want to hang. All he said was that he doesn’t care and that we’ll see. I hate when ppl don’t communicate back and now my anxiety is through the roof! And he literally told me the other day that he has a wall around him bc he’s been hurt badly before. I know he’s working for the next 5 days and I’m nervous he won’t want to hang out, even if it’s just to talk and move forward in whatever direction that is. He’s going out tonight with friends and he semi invited me but now doesn’t want me to go. I literally feel sick to my stomach bc I feel like I messed up so bad but he’ll never see that. Idk what to do?? I don’t want to let him go because we vibe so much and the fact that he told me I’m more than just a hook up last night gives me hope but idk 😐