Baby’s father threatening me

So me and the child’s father had a hook up and I became pregnant. At first he wanted no parts. Its either I was going to have an abortion or sign his rights away. When I decided I just couldn’t go through with an abortion and I’ll just raise it on my own with the support of my family, he decided he wanted to be apart of this. But now he’s saying I better be able to have all my shit together because if his parents even think I’m unstable or can’t care for a baby they’ll try to take my baby away, saying their lawyers are better than mine and they will win. Now I’m scared to death because I am going to be a young mom and I might struggle a bit but I don’t deserve for my baby to be taken away. After him saying all that I’m back to thinking about having an abortion because I don’t want this drama. I can’t believe I got myself in this mess.