Am I in the wrong?

Long story short. My husband and I have been having financial struggles so we really couldn't afford a vacation this year again. Which is not the end of the world. My parents and my brother and his family are going to the beach for a week. My mom offered for us to go, she would cover the cost. I told my husband and he says going to beach with my family doesnt sound like a good time to him. He doesn't really like the beach. He gets along fine with my family for the most part, just dislikes my dad since he supports trump. However i love the beach and would love for my son to experience it again (he's 5 and went to the beach at 2). I told him that's fine, but i would still like to go and take our son too. He was very upset about this. Says he shouldn't have to be stuck alone for a week and how he wants to use pto for a vacation for just us. Which he then agreed that we can't afford. Then states if he decides to go, that i should show appreciation for him for his sacrificing his time and pto (he has unlimited pto) to go to the beach when he doesnt want to. I simply stated if you don't want to go, then don't. I'm not going to force him to go on a FREE vacation because he doesnt like the beach. But i feel like i should still be allowed to go even if he's doesnt. Any thoughts?