Need help

So I need some opinions...I was engaged to the man of my dreams and everything was great. I would do everything for this man. I cleaned his house (we were waiting until married to live together), went grocery shopping, paid off his truck so he could get a new one, ran all his errands, etc. Suddenly his ex decided to file for custody of their daughter. I tried my hardest to support him, but he told me I wasn’t the right one for his daughter. His father and step mom told him that he was going to lose his daughter if he stayed with me. His dad actually told him he would lose his daughter, truck, house, boat, everything if he stayed with me and that I would never be welcome at his house. We were off and on for 5 months since then constantly splitting because his daughter didn’t like me or his family was gonna disown him. He always said he wanted to be together and that I was the only one he ever saw himself being with but he didn’t know what to do. In May I decided to leave because I was over the disrespect from his family and he would never stand up for me. His daughter would constantly give me hugs and say how much she missed me, but he said he had to put her first which I understand. So long story short I left and started seeing someone else. Well this week he started calling me telling me how hard it was without me and how he just wished we could be together. Well I told him that I had seen someone else and he got really upset and told me he thought I would understand the situation and give him time. Now I’m so lost, do I go back and be with the man I love and have always wanted to spend the rest of my life or do I keep moving on. I like the guy that I been talking to and hanging out with, but I don’t necessarily see a future with him.