annoyed with husband

My husband likes for us to spend wednesday nights with his brother at a game night. We have a group of friends come over and we all just hang out. Sometimes my husband will want to stay late into the night and when I ask him if we can go home (if I'm tired or anything, I'm in nursing school) he says no and we end up staying. Well today being Wednesday I know he has plans to go, but I feel like we haven't spent much time together this last week. I also am currently fighting a kidney stone and UTI so I feel like I should take it easy and rest at home. When I asked hubby to stay home with me he said no. I feel pissed& hurt, I know I probably shouldn't, but we go EVERY Wednesday night! He can't miss one??