Would you still leave without a shadow of a doubt?

You and your baby’s father have an infant. Say 6 months. He’s cheating and you’re tired of it. Would you leaving knowing your baby never even got a chance of having unity in the home? Is it being selfish to leave, like am I cheating my son?