Am I a bad mummy to be?

Okay story goes.. I broke up with my ex (father of my unborn baby) due to him being possessive, controlling, nasty, raising fists etc. I also broke up with him because of his severe drug intake. He lied to me constantly time and time again saying he'd given it all up. I stupidly believed him every time. He'd then come over to mine high as a bloody kite infront of my young sisters smelling of drugs! Ever since I've ended it with him all he's done is caused me 'domestic abuse' stalking me, harassing me, following me, stalking my sisters, cyber bullying me, hanging around down my road etc. I've involved the police and all they did was put it down to domestic abuse and give him a 'warning' letter. My midwife contacted social services because of his background. His whole family are involved in drugs and drink. I didn't know this until the end of the relationship. I've always said to him that I'm not stopping him from seeing this baby as long as he can prove he's clear from drugs. I'm not willing to have him back round my house high as a kite infront of my baby or my family. I'm not willing to let his family come anywhere near my baby either because all they do is get high and get drunk! They've also all got criminal records (I found this out recently) I'm trying my damn hardest to safeguard my life and my baby's life. He will not be going on the birth certificate because I'm not willing to let him have parental rights when he can't even look after himself!