Is it just me?

Ok so me and my hubby have been married since May of this year. His family and friends are all really really close and my family is more like...see you when i see you. But he has to see his friends and fam like everyday and some days i just want it to be us you know? When i bring it up his reply is that he is spending time with me and thats just what he's used to. I hate it. We can be having an awesome day and one of his friends will call him and he hops up to go play the game. He will ask me if its ok but i know if i say no he will pout lol...idk i just wanna know if anyone else has dealt or is dealing with this and if I'm just being selfish. I don't mind him hanging out at all...just not everyday - and scene ?