Very important question!!!

So me and my baby’s dad aren’t together found out he was cheating the whole time and is now with the girl he was cheating with but I was wondering is it possible to co parent with a newborn? Like he’s gonna be so small and I’m scared with this covid stuff going on and I just worry sometimes but also I his family is very distrespectful and I don’t trust them but if I tell him the baby can’t go over there he thinks I’m trying to keep him from him I’m so stuck someone please tell me it’s not really reasonable to go back and fourth with a newborn plus I’m gonna be pumping.