Threatend !!!!

Baby daddy threatends to take me to court and take the baby away when he/she is born .... there's no way unless I'm in some kind of stuff and been arrested rite ? He can't just take the baby away , he can only get days when he can have the baby ? Am I rite ?