Thinking of breaking up..

I been with my man for 3.5 years and we have a 7 month old baby. He’s put me through so much and I always forgave him and let it slide & things were better for a while but lately I’m just not happy, I’m always sad. Let’s just start with we live together but I’m a stay at home mom so he pays the bills and calls his money HIS money so I never get any or i never want to ask him for any money. & recently he started basically kicking me out, he kicked me out once over a dumb argument but I had no car at the time so I just went outside to call a friend who can give me a ride to my moms and so I had came back and packed some stuff and as I’m packing he’s apologizing and basically saying not to leave so I stayed and then a couple weeks after that he brought it up again during an argument he just said “why don’t you just leave” and he regretted it & I told him if he even brings up that subject again I’m leaving with no hesitation & this past weekend it happened over an argument that started bc he went out with coworkers after I had asked him to come home & he stayed out and got drunk and drove home drunk & so the argument escalated to him saying “why don’t you leave then” constantly over and over and he said I don’t make him happy that ALL i do is watch our son and after that I had enough and packed some stuff and left. He let me walk out the door like nothing, didn’t even text me or call me nothing. Immediately turned off his location. This was Saturday, the day before my FIRST Mother’s Day. I was a mess i was, he was fine. I stayed the night with a friend & next morning he told me come home we can talk just come home that him and my son have something planned for Mother’s Day & he didnt. It was a horrible Mother’s Day, horrible weekend. And it’s my birthday month so it’s just horrible. I ended up coming back and I’m not glad I did. I’m having doubts bc i don’t want the relationships to end but how can I be with someone who I’m not happy with and isn’t showing that he’s actually changing to be a better person? It’s easier said than done to leave for many many reasons & im just lost, drained, upset in myself... any words of advice? Any one of you been through a similar situation?

May I ask how you guys finally got the courage and strength to completely walk away?