Advice

So this guy and I been talking for a couple of months now. We had sex about four times. But all of the sudden he’s acting different. And I told him “if you don’t wanna keep messing around or have anything to do with me that’s fine. I just don’t like being in the dark”. He responded that he cares about me and he still wanna mess around but he doesn’t want to be in a relationship. Which I knew from the beginning. But the thing is he saying one thing and his actions are completely different. Along with his words. I just don’t know if he’s keeping me as a side piece or if he truly fucks with me. Cause I need to know if I should be the one to end things.