I need positive advice

Currently due any day now and recently separated from my child’s father we are not married btw. My whole pregnancy has been hell dealing with him and I feel bad as a mother for putting up with it as long as I did from mental abuse to at times physical, the other day I reached my breaking point decided to change my number and crop him totally out of the picture, my child needs peace and a stress free environment. He is now harassing my mom calling her sayin he wants to be in the room but honestly I don’t won’t him there I jus want peace I feel a little bad because my baby did ask to be here and he has an ass hole of a dad what should I do ..? Should I keep my distance or jus let him be there.? Btw he hasn’t bought anything for our child and I told him I was pregnant last oct he has a job but chooses to by marijuana with his money and gym shoes and games for his Xbox which has caused most of our arguments