Help separating with a newborn

Without going into too many details The baby’s father I live with is what he considers polygamous so there’s another female here.

The baby is mine and his. After a fight today they have decided to leave and custody was talked about. The baby is currently 4weeks old. The conversation turned into both of them threatening to take him from me. Going for full custody and or making it so I can’t leave the county. My question is what are my rights when it comes to leaving. Nothing has been filed with the court yet, am I able to leave the county to file for custody somewhere else. There are other details to this not me wanting to play keep away