unsure what to think

opinions greatly appreciated please. I was with my ex husband for ten years, separated from him the last 4. he's been trying like crazy for about year now to get me to come back, well he tried after I left but not like he had been. we have become the best of friends like we used to be but we're both grown now so it's deferent. Ok so the reason I left I caught him having an emotional affair, felt really hurt and at the time this one guy was after me hard so I ended up doing the same. ended up leaving my husband for him. before I left I had told him what was going on and he tried, he really tried. but at that time I felt it was too late, what I fell for was a controlling, manipulative, women beater, who only wanted what my husband had. which was a good life, we had a great life together. I will admit with 4 kids and a very demanding job, my husband was put on the back burner long enough that he sought out what he was missing. my question is, should I really try this again with him, or just let it stay the past. I do love him there will always be something there with him to the point I know if I have sex with him it will be nothing standing in my way. help please