feel guilty for breaking up with my abusive bf !!

I just got out of an emotional abusive relationship that lasted 2.5 years and I don't have any friends or anyone close to me, and my bf now Ex is going through hard things in life with his family and I still feel that I want this relationship back and I feel bad for him and that he has none to support him and be next to him but Godddd he told me that he doesn't care if I stay or leave. I had to deal with all kinds of emotional abuse for 2.5 years because of his family and I don't know if I'm right or not for breaking up with him !! I just love him and I'm so broken (he is my best friend for 9 years either)