I need some sense knocked in me!! Help!!

I have a month old baby that I’m madly in love but me and her father haven’t been getting along at all!! Everyday we’re fighting and arguing there’s just too much hurt to get over it.. he cheated on me multiple times while i was pregnant. Continues to be sneaky now. Goes out all the time but complains to take care of his baby at night. Has no job. And is always yelling infront of the baby. I live in his house. Anyways I’m talking to my grandma about moving in until i finish school and get back on my feet. I’m just now feeling scared to leave.. idkk why ☹️ i wanted so badly to leave and now that i May have the opportunity I’m feeling scared. Can someone please knock sense into and tell me what i need to hear to leave this damn house and toxic ass relationship. I’m feeling like maybe it can work if we keep at it and be hopeful. but it’s been almost a year and at this point things are getting worse.. 😔