When to let go

So my relationship has not been great lately. I am the only one who cleans the house. I wake up and get his coffee ready for him and his clothes before he has to wake up (no matter how early, even at 3 am) he won’t fix anything around the house. Even though he was a carpenter for 15 years and can easily do it all. All he wants to do is ignore me for Facebook lately. And he calls me horrible names like “stupid bitch, and worthless piece of shit”

I have been trying to see it from his side. So here is what I can put together from what I think is going on in his head:

He has to travel sometimes for work so there’s a whole week away from home. He doesn’t think he can trust me because I had a MINOR fuck up at a bar a year ago. (Didn’t cheat on him. Got a ride home from my friends roommate who turned out to be a guy. I went home drunk and safe and slept alone in my bed.)

When he is not traveling he works hard here at his main plant. And I also have a full time job. So he wants me to come home and take a minute to relax and then get to cleaning and cooking so the house is clean how he likes it. While he plays on Facebook until he’s ready for bed.

And yes he does sometimes clean the house very thoroughly when it needs it. But he holds it over my head for months after that.

Last time he traveled I found out he went to a strip club with his boys from work. (Which he told me he would never do cause he doesn’t want to look at nasty naked girls). Then he goes and says that he is at the bar next to the strip club cause it’s the only one in town. But that’s not true there’s at least 10 more on the street.

And now he is home and livid that the sheets were not dry by the time he was ready for bed. And now I’m a “worthless piece of shit”

Anyway, my question is, after 5 years of great goods and horrible lows in our relationship should I just respect myself and let go? Should I leave? He has told me so many times that he will leave me. And told me to leave many times because everything is his. It all took his signature to get. Not mine. It’s a very hard thing to do decided