My unemployed boyfriend? When is enough, enough?

I'm tired of my bf not having a job and being broke. I don't know what his issue is, lazy, unmotivated, scared or lazy? I feel so much resentment towards him for not keeping any promises he made. Every time I am ready to leave I end up feeling bad, and I get manipulated into thinking I am selfish. I met my bf at work, then he quit and had about 5 jobs after that. We have a 2 month old baby girl, a month ago I quit my job and my apprentice position at a salon because he swore he found a job that would pay enough to take care of us. I didn't have transportation to get to my jobs (he was taking me) and we didn't have a babysitter so that meant staying home for alil while. We agreed til baby was 5 months my mom can take care of her and we'll pay her. So I quit both jobs and as days passed nothing was happening. I was getting anxious and worried since I had bills to pay, I then asked him if he received a called and he hasn't. After nagging him for a week my bf calls and they tell him to come in for a second interview and an assentment test to take. I then got upset because he told me he was certain he got the job. He goes, fails the test and doesn't get the job. He feels shitty for making me quit and we fight the whole week. Then surprise they call him in for another interview. He goes he says it went great but now its been 2 weeks and nothing. This whole time I've been telling him to apply to different places and look for work. We don't live together, every time I bring up how we will never live together or have our own home he says it is my fault for choosing not live with him and his parents. He says he will get a job, but he has been saying this for months. He use to go out everyday to smoke but he finally stopped after so many arguments. He does help me with taking care of the baby, and all we do is go over his house and watch Netflix. He finds ways to get money, his mom PAYS him to clean their house, 100$ which he uses on pampers or gas. he worked Christmas <a href="https://play.google.com/store/apps/details?id=com.glow.android.eve">eve</a> and last night at his moms job to earn some money. When I ask him why can't he just work at his moms job (Popeye's) he refuses, says working in the kitchen is really "brutal" and too hot. He also doesn't want to work anywhere minimum wage, says its bs to work so many hours for a a small paycheck. I am tired and want to leave but he guilt trips me so bad, he is not on the BC and I know he won't take me to court for custody since he is too broke for a lawyer but I also don't want to be the reason why my baby doesn't have her dad around. Working out an arrangement with him will just be full of drama and he even tried taking her one night and was kicking me out his house. I have been n applying everywhere for 2 weeks and hopefully I land a job. I told him if I find a job before him he will take care of the baby but I will not be finicially taking care of him. I am hoping I save enough before the summer to buy a used car and find a small apartment for me and my baby and move out my parents house then find a sitter and leave. I feel like I just using him now to get around to places. Am I wrong to to want to leave? Should I keep on waiting? Any advice is welcome!