Am I being selfish wanting to break up?

So my realtionship has never really been great but when I was younger I would never dream of breaking up with my partner no matter what. You don't need to tell me how stupid I am I already know 😂😂 we'd been dating for a while but he had basically ghosted me when I found out I was pregnant. Neither of us were expecting it as I was on birth control. We had the baby and stayed together. At this point I didn't have social media and I made accounts to share photos of baby with family. He added me on Facebook but he had obviously forgotten that he had photos on there of him and a girl basically making out. They had the date printed in the corner and it was from when our baby was a month old. He quickly deleted them and I was young and never had the balls to confront him. he got fired from his job so he decided to find a job in a completely different city. (There were plenty of jobs where we lived)

He ended up staying away for five years and pretty much living the single life. He never sent any money for our baby but would tell people that he was working away to 'provide for the family'. He would ring me up constantly and ask me for money. We would see each other every few months or so, he cheated and gave me an sti and tried to gaslight me saying that I had cheated because he didnt have anything. I told him to decide what he wanted to do with his life because he was missing his child growing up and we moved in together and tried to make things work. Things really seemed to be working and after a few years we had another baby. Hes never really done any childcare as he believes that is the woman's job but I love doing that stuff. Also I pay for everything to do with the kids, clothes, food, school stuff ect. then I got pregnant on a different type of birth control, apparently I'm very fertile. He acted like the whole thing was an inconvenience to him from the first pregnancy test to losing the baby at five months. He even told me he was wishing that I'd lost the baby after I came back from the first midwife appointment. It's been two years since losing the baby and there's no working this out. Everytime I look at him I feel nothing. funny it took losing a baby for me to really lose feelings for him when it's clear looking back that he only stayed with me because I was pregnant. But when I mention things aren't working out people always say oh splitting up would be unfair on the children. Personally I think we'll all be better off if we break up children included. Am I just being selfish?