I need opinions...

So today my SO and myself got into an argument over money. We have a daughter and just had a miscarriage. He started saying he's going to pack up and leave and I was asking him why and begging him to stay. Finally he started saying really nasty things like I was a cunt and a bitch and that he was tired of living with me. Then he started to say that the miscarriage was my fault and that he's calling social services to get my daughter taken away from me. I love my daughter unconditionally and would do anything for her. She's taken care of and I always provide for her. But I was so upset that he was saying this that I finally snapped and started helping him pack. He didn't like this so he threw me on the bed and held me down. I snapped and lunged for him which ripped his shirt. I backed off and told him to get out and when he said no I grabbed his bag of clothes to move them he pulled me off and threw me into my daughters crib. After that he left and he told his family and they're siding with him. Well I guess I'm asking am I in the wrong here?