He’s cheating on his girlfriend with me

So I’ve been dating this guy for about 7 months. During that time we never made things exclusive but dang near spent all our time together and i literally seen him every day. Just recently I found out he has a girlfriend and when i confronted him about it he didn’t deny it and actually beg me to stay. I’m not going to sit here and stay in this strong women because i have my weak moments. i cussed him out and ignored his calls and texts but now apart of me what’s to talk to him. My feelings for him are deep and even though we were not together, finding out he has a girlfriend crushed my soul and I know it’s going to take a min to get over him. He never treated me any different and we were always together that’s what made me so confused on how he had the time to cheat on her! Ugh i just need some positive vibes and some wine 😔