Feeling Blue...Help!!

So I just broke up with my boyfriend becasue he got super angry that I didn't spend time with him and a party and started calling me stupid, retarded, and said' at the next party, you bet your ass that you will be next to me the entire night!!!' I didn't feel like that was okay so I broke it off with him. A week later he said he was sorry and that he wanted me back but I said no. He immediately got discouraged and started crying in my lap and I feel awful about it. Was breaking up with him the right thing to do?????