Advice please

I am in a new relationship with a guy. We have been together for about 2 months. He's great at times but it is clear he has a lot of issues going on and anger management issues till the point where he gets it out on me. He has kids and I have a daughter. I understand he has to be in contact with the mother of his children but everytime they argue he gets it all out on me and start name calling me. He starts saying how he is sick of me and I can leave whenever. This is the second time he does it. The next day he acts as if nothing happened at all and admit it was not right. But never fully apologizes and says "I'm sorry." That's another issue. He never apologizes..