Would you end a 8 yr marriage over this?

My baby was up all night and husband and I became frustrated with each other. At one point when I was holding and trying to soothe the baby my husband said to me that I make him want to make things violent. I told him he was crazy for saying that while I held our 6 week old baby. Later time went by and I told him I couldn’t be with a man who I love saying things like that to me and his response was get over it, it is what it is. At this point it seems we’re always arguing when the baby becomes fussy and it’s a long night so I’m just now thinking about focusing myself and my baby.