Just ended toxic relationship/friendship

I posted on here a couple of days ago about whether or not I should continue a cordial, not invested friendship with a man I briefly dated because I felt like I was his only friend, even though he treated me badly. I listened to y'alls advice and told him how I felt and that it was better for us to go our separate ways. That I like so many things about him (besides when he's being a dick out of left field), but that our personalities don't mesh and it is not healthy to continue on, that it is exhausting. He was understandably upset, called me a liar, told me to go fuck myself, and delete his number. I feel like a huge weight has been lifted off my shoulders, but I also feel heartbroken. I hate hurting people. I would rather be the one in his position. I think I could take it better. How do I get over this guilt?