Need Dating Advice Please-Sorry for long Post-

I'm currently dating a guy, been with him for 6 months now, and it's been amazing and all but there's a problem. I think I rushed into the relationship and can't seem to be able to break it up. My ex decided to leave out of state on the opposite side of the country about a year and a half ago, we broke it off since I had tried long distance relationships and they often left me heartbroken. As soon as he left my depression kicked in, seeing him through Facebook being happy without me honestly destroyed me, I even met up with his best friend who told me my ex had met some one new, at this point I was legitimately depressed, how could someone just move on so fast? Did I really mean nothing to him? At this point I created an account to a local dating app or hooking up app, whatever you want to call it, and I started meeting people, nothing too crazy. 2 weeks later I met my current boyfriend on that app, we met up, and stuff happened and I thought oh well it's just a hook up so I left thinking I was never going to talk to him. He continued trying to talk to me and well point being he apologized said he wasn't just looking for a hook up so we eventually started dating, all this was too fast but my ex was happy so I deserved to be too. My boyfriend soon after got a better job which was 5 hours away so he basically lived there and only saw him on the weekends. I was okay with it and didn't break it up since I was still going to see him. Fast forward to my birthday, my boyfriend gets me lots of gifts and takes me out and I was so happy. He left back to work that day, we celebrated my birthday a day early. 4days later I get a message from a random number, I answered after I got out of work which was like 2 am, it was my ex he told me he wanted to see me and that he was in town, after me being inside my home saying no and him being outside saying please. I decided to go outside he had flowers and giant  pocky, which is my favorite. We talked all night since the next morning he was taking a plane back home, we kissed and we told each other how we felt about each other, he told me he never dated anyone after me, he asked me to move in with him. He left. Soon after my boyfriend came back home and I told him the truth, he took it as it didn't matter and said it's ok just please don't leave me. He always tells me how happy I make him and how he hasn't been happy in forever. That's why this is killing me it was only a kiss with my ex but the feelings are there. I tried breaking up with my boyfriend multiple times but he always cries and then I feel bad and I pretend like it's all okay. My boyfriend doesn't deserve a bad person like me and idk what to do. Please help me.