Husband's Family

Jamie
So my husband and I hardly fight, but when we do, it's always Bc of the same thing: his family.
He is Mexican and is very dedicated to his mother. She is extremely over bearing and hard to deal w at times. But his family is not even the issue. 
My husband works ALOT. And me and my two little ones don't see him much. He takes very little time off work and takes about 10 days off every 6 months of that. Every time he gets time off we have to nakenanteip 16 hrs away to see his family (It never involves seeing my family too Bc it takes two days driving w the kids to get to his rents so he thinks when he does have time off he just wants to see his so I always have to take the kids to my family alone which is also antwonfay drive). 
The main issue is not teally even w his family it's that he acts like a total dick when we go EVERYTIME. He is so hard and mean to our 4 yr old when we are there and compares him to his cousins. He acts like there is something wrong w our son and won't pay attention to him and just yells at him. He is also intolerable w me but yet he ALWAYS blames everythig on me and sees he acts that way Bc i always have an attitude abot going ect. Yes I do yell at him but it's only to defend out son Bc I feel so bad for him.
This may sound extreme but this has been going on for years and has only gotten worse and I could never tell him to choose his family (which I really like his siblings) over me so I am really contemplating leaving him Bc I can't keep doing this and subjecting my son to that every time we go there. 
What would you guys do?
TIA