Heroin and pregnancy!

I am completely sober and have never touched hard drugs. My ex fiancé is a heroin addict. We broke up about a month ago now. And I’m 6 weeks pregnant with our first child together. He says he wants to be involved with the baby but only after it’s born and he doesn’t want to talk to me he ONLY wants to see the baby. I said coparenting involves communicating with each other. I told him if he cannot talk to me over the phone (were talking through a mutual friend) then why would i think he wants to be involved with the baby? Am i being selfish thinking if he cannot communicate with me then he doesn’t need to be around me at all? He wants to show up to my OB appointment in 2 weeks and I told him no. Idk if he’ll actually show up. But he has already hit me before. And i don’t want to see him in person. Sadly i still love the man but I’m not ready to be face to face again. Not yet. Is it wrong? Not like he can come into the office with me either since Covid.