Am I wrong?

Okay I have a dilemma ladies!! I have a 5 month old baby girl. Her dad and I had a falling out and he left me during my entire pregnancy( didn’t help with anything and barely does anything now).. Fast forward to her being born , we get a dna test it comes out she’s his. He doesn’t want to be on her birth certificate, idc that’s his prerogative. Mind you during my pregnancy he wished death on my baby and I several times. Now here we are 5 months later and he’s telling me I’m bitter for not letting him take my baby to his “house” or around his “family” .. but why should I? She’s breastfed and why are you trying to rip my child from me and she’s so young? I get you don’t want to be around me but trying to take my child from me and I can’t know where she’s going or who you’re taking her around is an issue for me. Am I wrong for not letting him take her because I don’t think I am! He’s telling me I’m bitter because he doesn’t want me but i don’t want him either ! I offered for him to come sit at my home while i take my other daughter to cheer for 1 hour and a half and he couldn’t do that after agreeing that he would. He’s only seen her 6 times out of her entire life.. I just feel like he’ll have to take me to court because I just can’t allow him to take her at this time 🤷🏾‍♀️ sorry for the spill it’s some anger built up 🤦🏾‍♀️