Lost. Should we break up ??

Let me start off by saying I’m currently 23 weeks pregnant with a baby girl. I have a four year old daughter as well. My boyfriend and I have had our ups and downs. Some ppl in our family probably think we should have split before now or ever getting pregnant. He’s cheated on me twice, that I’m aware of, and both times with his ex girlfriend. He also been caught texting her more than once as well. Long story short I forgave him and we ended up getting pregnant. Today, I was FaceTiming my friend on his phone and when I hung up I seen a missed call from her number that I blocked forever ago. I got mad and just said “wow really” and “I can’t believe u unblocked that bitch”. Pretty much what anyone would say that seen an ex calling their SO. He instantly gets mad at me and starts walking away saying he’s probably not going to come home from his parents house when we go visit. In his defense his phone was messed up at the time she called. (He had black screen but the phone still worked he just couldn’t block her # bc he couldn’t see). I fixed his phone for him like 5 days after the call & just got my days confused. In my head it seemed like he had purposely unblocked her #. I apologized for assuming so quick but It was a misunderstanding. We finally get back home and I just straight up ask him if that was really worth staying away from his family and he said yeah it was. And I was like so you’re staying in Florida? Leaving your job and unborn child bc of an ex? He replied “i don’t know. Probably”. I just feel like this relationship is doomed. Should I just tell him to stay home w mom & dad? Should we take a break? Idk what to do. None of my friends try to give advice. I’m always that friend. That’s why I’m posting here.