Opinions please

I need opinions because I'm feeling like it's messed up that every weekend for the last few weeks my husband goes out on Friday or Saturday and leaves me with the baby. Knowing damn well I deserve to go out also. Even if it's just to a friends house drinking I want to go and he says he doesn't want to take the baby. (This friend had a baby too) so I end up having to stay in with the baby while he goes out for fun. I love that he gets to have fun but I feel like it's unfair. This weekend he wants to go to a Harry Potter trivia thing at a bar that I wanted to go to as well. But no I'm gonna have to stay home. He said he wouldn't go cuz I told him it's unfair that he does out every weekend but I was like no please go I don't want to be that person that holds him back. I just want him to understand how shitty I feel never doing anything fun. I'm a stay at home mom. I'm constantly with my baby. I love her more Han anything but every good mom deserves a few hours of fun! And if not can hubby please spend one night taking care of her!??!? Edit: every once in a while we get someone to babysit only for important things not just a night out on the weekend.