boy problems

I was with a guy for only a month. It was long distances, between the few weeks of getting to know each other I fell for him. I wish I didn't. He broke up with me the same day we had our anniversary. Few weeks later, a new guy comes along. I told him I still had feelings for my ex he understood in some sort of way. The new guy is really sweet and practically everything a girl could ask for but I'm not feeling him like he could pour his heart out to me but I'm not really into it. I ended it with him a few days ago and I'm wondering maybe I made a mistake. Any advice?