I need some serious advice.

I am 24 weeks along with my sweet rainbow baby.

When I initially announced my pregnancy to my daughter's father, he was overjoyed. We were in the midst of moving from our apartment to a farmhouse on the farm that I manage, and tensions were high. My now ex s/o has PTSD, manic bipolar disorder, and has been diagnosed with a general personality disorder. He has always been somewhat of a loose cannon. When I was about 6 weeks along, we got in a fight and he choke slammed me into a wall and said "you should just get an abortion, I don't want a baby with a psycho b***h". I kicked him out, but broke down and let him move into the house with me. About 3 weeks later, we were settling into the new house, and took our dog on a hike. We were crossing a creek, and he threw a 12 inch piece of slate at me and my dog. It hit me in the upper thigh and I said "gee thanks, a*****e". He proceeded to scream at me, tell me that he's never done anything but provide for me (he hasn't had a job in almost 2 years, I pay all bills, work 2 jobs and take college classes) and make a giant scene.. so much of a scene that I had to leave him on the trails because my dog began to growl and bark at him. When we got home, I ended it. I told him to get his things and leave, I couldn't do it anymore. I went to a friend's and received a text from my boss later that evening that my boyfriend was laying in the yard, crying.

Now, he messages me daily telling me that I'm a terrible mom for not keeping him around, and begging me to let him be around for my pregnancy and our daughter's birth. I cannot get over the way that he let me handle my diagnosis of cervical cancer alone, let me take care of our house and all of its expenses alone, and all of the horrible things he has said to me. But I am now wondering if I am putting my own ill feelings against him ahead of our daughter and her best interest.. should I let him be involved? I need some serious advice, because I'm at a loss.