Leaving my boyfriend while pregnant

Hey ladies I need some advice! I am currently 16 weeks pregnant and my boyfriend and I have been together for almost 2 years. We have constantly been arguing because he cannot hold a job and my biggest issue is we have a baby on the way and he isn’t going to be able to support us. He has had at least 10 jobs in the two years we’ve been together. He says he isn’t doing anything wrong at work to lose his job but obviously something is going on, he wouldn’t just get fired for nothing. He lost his job two weeks ago, way before he lost this job I told him if he lost it I was done and I was leaving. So when he came home I instantly knew something happened he didn’t say hi to me so I asked him what happened at work and he told me they walked him out. I’m so beyond frustrated and I have been talking with my mom and she said I could move back home until I can get on my feet. Does this make me a terrible person because I am taking his baby with me? I would totally do visitations and everything I want him to be apart of the baby’s life but I just don’t think it’s fair to the baby or I to have him lose his job every time. I have been at my job for almost 3 years now and I know it’s a stable job. Any opinions?