Mentally/emotionally abusive child’s father

I’m officially at my breaking point with my boyfriend/ child’s father. I’m tired of being manipulated, controlled, threatened , cursed out in front of my baby. The entire relationship is toxic. I need to leave him, but he has already threatened that I took his child away from him, that he would have me killed. (I believe him.) So when I leave him, I’m going to have to do it and get out while he’s at work. He is on the birth certificate, but we are not married. What rights does he have when it comes to our son? I don’t want him around my son. He’s a decent father, but he has such short patience with him, he has threatened to spank our 13.5 month old son. (Even when he was 10 months old.) With that being said. I don’t trust him alone with our son. Any advice or support is appreciated. I am tired.