Cheating boyfriend

My Boyfriend and I have been together a little over 2 years. Because of a situation with my parents, I ended up moving in with him kinda fast. Well over these 2 years there have been a few occasions I have caught him talking to ex-girlfriends, Co workers, and women that he has dealt with before me. I stayed bc I had no real evidence that he physically cheated and I wanted the relationship. Well recently I pretended to be someone from his past and texted him from an unknown number. He fell for it we ended up texting for a few hours. During that time he admitted that he didn't love Me and was just scared to be alone. He even told her that I cheated on him which was a lie. He was even willing to meet her at a hotel. He also told her that he missed her and if they had a shot, he would leave me. I'm devastated and I don't know what Ill do but I have to do something bc he keeps showing me that he's a liar and untrustworthy! I feel so played . He doesn't know that I know and it's eating me up to pretend everything is OK!