How many emotional affairs warrant divorce?

My husband is on his 4th emotional affair I’m aware of. This is a very new marriage and 3 happened before. Yes I likely should have never married him but I’m here now and I feel like I need to get out. Is it an overreaction cause everything I read about emotional affairs doesn’t say anything about divorce? People will say you’re gonna leave one cheater for another and cheating isn’t a deal breaker but I just don’t think I’m emotionally strong enough to go through this again and again. He says no to counseling.