Toughest part of being a single mom

What's the toughest part of being a single mom? For me it's not taking back my sons father after everything he did. I kicked him out with good reasons in hopes he would change. But my son deserves to have his father in his life and it hurts me every day I look at him