My fiance keeps trying to leave

My fiance and I have been together for 2 years and engaged since February. We just had a baby boy in July. We get along for the most part but when we fight it's big. I'm bipolar and have anxiety and have been off my meds for a year through my pregnancy and breastfeeding. Many of the fights have been pushed on me and my attitude but we get past them. I truly have been working on myself and being mindful of how I'm acting and he has pointed that out. But everytime we fight, even if it's about something he had done, the blame gets put on me. Recently, he lied to me about joining a kickball team. We were supposed to join together but they didn't have a spot for me, he asked if I minded if he still played and I said I would mind because it was something we planned to do together and he plays flag football by himself every other season. But apparently he joined anyway. He told me 10 minutes before he had to leave. Then he was gone wayyyy longer than the time for the kickball game and he texted me 4 hours later saying the game got cancelled and he went to his parents. Today I calmly confronted him and told him that was rather selfish and he blew up on me. Then as he was leaving for work he said when he got home we would talk about us because he's "done". That's his go-to every fight, that he's leaving me. What do I do?