SO has an issue with guest/company

Does anyone else’s SO have an issue with people coming over... occasionally I pick up my little cousin from school and today no one was home to let her in. She’s in middle school.. her mom works till about 4. Anyway no one was home so I brought her home to my house and my SO is irritated because he doesn’t like company really, or being thrown off his routine(his words) because he has to go to work right now.. I’m not sure how it throws him off?? But he made it obvious he didn’t want her here(rude af). I said are you going to say hi? And he said hi in an irritated way. Seriously? Then brings it up in the bedroom, and I tell him it’s not a big deal.. she was locked out of her house, it happens.. and he things it’s such an inconvenience and it is a big deal.. I’m said, I’m sorry but your not the only one who lives here, this is my house too.. and he walked away and shut the door to the bathroom cause he didn’t want to hear what I had to say.... what do I do? I love having company, family over.. but I’ve had to basically give that up because he doesn’t like it.. what should I do? What do I say? Where do we go from here?