The in laws!!!!!!

Idk if I'm wrong but I feel like my husband always just wants to be with his family. I work all day every day with a few weekends off. When I'm off from work he would be like oh we are going with my parents...or my mom's wants us to go here...or there having a get together. All I want to do is come home and relax but I can't. The weekends I'm off I want to spend time with him but his parents are constantly calling him and asking what we are doing...where we are...if we are going over and uggg it's getting me annoyed. I'm I wrong for getting mad and wanting to just stay home or be with my husband? I try to comprise but uggg it's so frustrating and we argue about it which I thinks it's dumb. What do you guys think?