should I be upset?

This is the second night my boyfriend makes plans to come over then doesn't & spends the night with his friends drinking. In his defense I said it was okay, but I really wanted him to say he wanted to spend time with me. I don't want him to hang out with me if he'd rather be doing something else, you know? I just feel upset right now because I wanted to see him