Would I be, is he right? Am I looking at this wrong?

He said I would be dumb to leave him...his words aren't matching up with his actions. We've been together going on 4years, there will be no marriage or children. I work for him under his business as an administrative assistant for 3 years, with no pay. Only because he keeps saying he's waiting until the money comes in. It's like now, I'm still trying to cover my @$$ so I can move and have my own place and be stable. His business isn't bringing in any money, but how long must I hang on his words, when there's nothing to show for it. His pissed now because I caught him in a lie and he said I would be dumb to leave him now. He says what woman would leave a man who says they're going to make you $20k+ a month, he said ask my girlfriends, I don't have any friends, he got rid of them too...any who, overall I want to make my own money, I do now where I don't depend on no man to pay for my bills, I pay for everything myself without his help....yet for someone to keep telling you something like this and its not set in stone nor on paper am I really dumb for leaving him, for trying to cover my behind when there's absolutely no money coming in? I understand he's trying to take care of me, but I need to make my own money to continue to stand on my own 2 feet regardless of what he's saying!