no bashing please! have you ever cheated?

I won't justify cheating, as I actually have always hated it. But... my current partner is very emotionally abusive. He always puts me down, stops me talking to people. Calls me names. Told me it was my fault I lost our baby, and still does to this day. Doesn't let me keep my wages. Cheats on me all the time, and still Dennies it. He's just horrible. I want to leave him but every time I try he manipulates me to stay with him. I've said we need a break, as we live together I've given him 2 weeks till he has to move out otherwise he will be homeless. I know it's not going to be a break, but if I say outright split it will be a lot worse than how it is. Well just before that I'd met someone who completely gets me, he's so nice to me. He actually treats me nicely, he was my incentive to leave this abusive relationship and so far we have only kissed. And as soon as we did I felt so guilty and that's when I told my partner we needed a break. Would I be wrong on this "break" to keep meeting up with the person I really like?