Husband rant!

My husband is so frustrating sometimes. We got invited by a friend to go swimming tonight. He doesn't want to go but says I can go without him. This kills me, he does this all the time. Anytime I want to do something, he doesn't or he's "too tired". But as soon as he wants to do something it's cool. I always try to be supportive with what he wants to do because I love him. I just feel like he doesn't support me like I want. Plus, if this was some one else (like his family)....ANYONE else, he would totally be up for it but because it's me, he's not......just ugh. Thanks for reading my rant.