Am I in the wrong? Probably too long!

The father of my child and his family (mother & grandmother) have been basically bullying me since the day I found out I was pregnant. We aren't together and broke up long before I found out I was pregnant.  I put a lot of effort into trying to get along with all of them even when I found out about the nasty things they were saying behind my back. (Calling me a whore, saying there's no way this baby is his because I sleep around, calling me a bitch, etc.) I had told him in the beginning since we had been broken up that we could do a DNA test and I wouldn't have an issue with it and he told me there was no need to do one. So I figured we had moved past that and we were getting along fine. Well then he starts telling people that I've been doing drugs and drinking my entire pregnancy so he's worried about the baby's development and when I confronted him about him, he said well you were taking pain medications before you were pregnant so I find it hard to believe you just up and stopped. I was really sick, had my wisdom teeth pulled and ended up with an infection and the antibiotics for it caused C-Diff. The antibiotics for the C-Diff caused iritis and I almost lost my vision in one eye! I also ended up with a UTI when all of this was happening, so I was taking several antibiotics, an anti inflammatory, and norco for the pain. I also took Ambien for my insomnia for 2 months around this time. This was back in December/January, early February. He knew I was sick, yet still ran and told people I'm an alcoholic drug addict. He's been telling people that for my entire pregnancy and I'm 8 months pregnant now. Before I found out I was pregnant I had gone on drinking on two different, spaced apart occasions, and barely had anything to drink, but to him that equals drinking even at 8 months. I felt really bad about that, and spent the first month I found out I was pregnant crying about it. After dragging my name through the mud that way and making it seem like I was a bad parent already, him and his mother began telling people I sleep around so there's no way this is his baby and they're doing a DNA test to prove that it's not his. I was extremely offended by that when I told them to begin with I didn't have a problem with doing one and when I asked him why he would lie to me about and then tell people I was sleeping around he began to insult me, calling me a stupid bitch, and calling me a fucking idiot and telling me I needed to shut my fucking mouth. Just completely blew it out of proportion. He went to the first ultrasound, then skipped the one to find out the gender because he didn't feel like going. Except he blamed it on me and said I told him not to go. Even though I texted him before the ultrasound and he ignored it. I had told him about a week earlier that if he couldn't handle being civil towards me and not calling me names that I didn't want to see him at any of my appointments anymore because I deserved to be treated with respect. He took it his way and told everyone that's the reason he didn't go and his grandma told him she was so proud of him for sticking up for himself. That's his excuse for not doing a thing the last 8 months! I began buying diapers as soon as I found out I was pregnant, and clothes as soon as I found out the gender and they expected me to give them access to all the things I had bought because he hadn't bought anything and that was just so unfair to me, and also the last straw. I told him not to contact me unless necessary because I got tired of him and his family attacking me and being rude. I told him necessary things included anything baby related, but I was no longer trying to maintain a friendship with him. It was to exhausting. No one in the family contacted me for almost 3 months. Then they only did because they weren't invited to my baby shower and were pissed off so the harassment started up again and the drugs/Alcohol, she's a whore, DNA test, it's not even his baby then drama started again and I put my foot down once and for all and told him that was it. They were not going to be present when she was born and if he wanted to go to the court and do a DNA and request visitation then fine, because I was not going to let them see the baby. If they could go months without thinking it was necessary to make contact about the baby, but could make contact to harass and insult me then they were toxic to my life and toxic to my baby! Now they are trying to make me feel bad about my decision. I've been miserable my entire pregnancy because of the way they acted towards me. They said so many awful things and spread so many rumors about me, then told me I couldn't make that decision because they're my daughters family whether I like it or not and our issues have nothing to do with her and I think it's bhllshit. I should not have to endure them treating me terribly then using an unborn child to justify it. They can't claim her, yet want to paint such a strong picture that I'm going to be a horrible mother so that I could lose custody myself over slander. They have said so many other things that I'm terrified if I were to even let them see her, they'd take her and not let me get her back.  So if you read this whole thing, am I wrong for finally saying enough is enough and not letting them be at her birth/see her until visitation is set?