Help advice

Every day my boyfriend ( baby father ) comes in late after work no phone call all day from early morning, comes back dosent speak to me dosent look at me, I walk in the room he walks out the room, when he speaks he calls me horrible names, dosent help me do anything, basically treats me like shit, well today I’ve told him not to come back after work because I’m sick of him making me feel like this!! He said yes I’m glad I want going to come back anyway!! My minds totally fcuked, I’m a mess, should I call him to come back, I feel bad for my child not seeing their dad, what do I do??