Christmas w family

How do you handle Christmas when you and your s.o have families that live hours apart? We live with his family which is two hours from mine. My mom thinks we should spend three days there at Christmas and is very outspoken about it. My s.o disagrees and think it's fine to spend one night. He thinks it's rediculous that an adult has to spend 3 days with her family for the holidays because I see them two days a month on average anyway. We struggle with this every year......Am I the only one who deals with this fight at each holiday, because it feels like it to me.