Need Advice Parenting and Relationship—lengthy read

My son just turned 1 end of March and my boyfriend (baby’s father) and I have been struggling relationship wise for a few months now. This is our first child. I feel like at times I’m a single mom doing all the work while he does whatever whenever. He talks about how he wants to be a good dad and the dad he didn’t have. We’ve been arguing over so much stupid stuff nearly every week. He tells me to get out of the house or he’s done and I am stuck on him because I do love him. We have been together almost 5 years. I feel like I’m falling out of love with him with the things he says or the names he calls me. We haven’t been intimate probably more than 6 times in the last 4 months. We have moments where we are okay and get along but I think I am fearing leaving because of how he would act as a dad when I’m not around. He’s not physically abusive, he rarely apologizes for hurtful words. I feel like I deserve better and not sure how to tell him without him getting upset and telling me to leave or that he doesn’t want to talk to me. He refuses therapy. I’m so caught up in the good memories I’m struggling with what I should do. His communication sucks with these topics.

I guess I don’t want to give up so easy. I didn’t grow up in a split family and I would feel like I’m failing my son. I would also think my boyfriend would go for someone he knows I don’t like just to make me upset. I don’t want someone to try to replace me to my son. He says he won’t date anyone after me if we break up…but that isn’t the point because he’s angry when he says it. I also don’t want to fight in court because his mother will push for everything against me if it came to it. I know our son would be better with me most the time because I know his routine or what to do in the moments he needs something where my boyfriend doesn’t.

Advice please!