For those that travel...

So

If you both are traveling with baby for multiple hours, is there a certain length you'd have one of you sit in the back with baby? Like only for road trips 4 hours and up? Or no matter how long, you both sit up front?

Hope that makes sense, thanks