Would I be wrong to ask

Long story short, I found out I was pregnant shortly after leaving a toxic relationship. The baby is 100% his, I haven't been with anybody else in over a year. Him and his mom have been telling people I cheated on him and that the baby isn't his. He's got his buddies, some I haven't even met, going around saying it's not his. One of his friends came with him to my gender reveal and made the comment that my baby probably won't even come out white. They're saying I'm probably making up being pregnant even though they know I've had ultrasounds, appointments, and why would I have a party if there wasn't a baby? He's even been with a few girls since we broke up and they've told me he's denied it's his as well. When he speaks to me and we're alone he admits it's his but denies it in front of people. His dad made him go to an ultrasound with me, and made him go to the gender reveal but other than that he denies my baby is his. My question is, would it be wrong for me to ask him not to be apart of my baby's life? It doesn't make sense that he will admit it's his and act like he's excited when it's just me but them say it's not his in front of his friends. I just want to ask him not to involved so I don't have to give my baby his last name or worry about having to send my baby with him. I don't even want child support, I just want him to either be all for being a father, even in front of his friends, or just not be one at all. I'm not gonna feel safe sending my baby with him once she's here knowing that he feels the way he does. He just confuses me. Should I just wait and see how he acts after she's born and give him a chance or go ahead and have the talk with him and see what he says, or if we can make an agreement.