Husband advice. Please don't judge.

Okay so I hope I can get some helpful advice. My husband and I overall have a really happy and great relationship...except for one thing. When he wants to go do something on the weekend with friends (which isn't often) like fishing, paintballing, going to see the races at the Laguna seca I get upset. Of course he can do whatever he wants and I would never stop him. He doesn't even drink or anything...but I get an attitude and I have NO idea why. I know he's not doing anything wrong, I know he has that right, I know it's healthy...but for some reason I get really upset. I usually end up having an attitude and kind of "ruining" his day. I honestly DO NOT want to be this way. I have no idea what causes it or why I get jealous. It shouldn't bother me in the least but it does. I think part of it is that he is in the military and so we live over 1000 miles away from any of our family. I don't know anybody here so I never get girl time and we never have a babysitter that I trust so I'm home alone all week with the baby. So on the weekends I look forward to having some human interaction with my husband and getting out of the house. Today he was watching a race for only a couple of hours and I got mad. He told me this was really bothering him and he just wishes he could do things on occasion without me getting mad. I know I'm completely wrong here but I just cannot figure out WHY I am this way. I want to change. Has anybody else ever struggled with this? I feel like such a horrible wife and I really want to be better. Posting anon because I'm embarrassed and have a feeling I'm going to get mean comments. Also, no we aren't young. We are both 27 and have been together for 8 years.