Holidays with the in-laws

Looking for some ideas/advice as to how to politely tell my husband that I have zero interest in spending the holidays with his side of the family. Most of his family has never been nice to me hence there’s really no desire on my end to have to deal with holiday travel just to spend an uncomfortable weekend with them.

Husband’s reasoning is so that they can meet our son and that we can be done with seeing them for this year. If that’s the reason, I don’t really see why it has to be on a major holiday. If seeing his family to meet some yearly quota is it, I’d rather see them on some random weekend during the spring or summer. I’d rather us spend the major holidays as an immediate family and make our own traditions.

I’m not even asking for us to split the major holidays (one with his side, the other with my side). Our families live in different states.

Thoughts?