I don't want my BD around my daughter

Majo
So, my baby is just 6 months old.
Long story short: while I was pregnant, everything went to hell with my boyfriend. He started drinking A LOT, getting in and out of rehab every couple of months, and he even hit me once and threw a knife at me. So of course, I decided to leave him..
and now, every once in a while he texts me or calls me saying he is all better now and wants to help and be a part of my daughters life but I don't want him to.
I'm trying to find work from home because I don't want to be away from my little girl, she already doesn't have a dad, I don't want to take away her mom too.
But it's really hard to find work at home that pays enough to support her.
Is it wrong for me to refuse to let him help me? I mean, I really think he would be the most absolute toxic influence on her life and I don't want him to hurt her, physically or emotionally. Isn't that more important? What do you think? Any advice?