Am I wrong?

My relationship is by no means perfect. We've had issues in the past with wandering eyes and trust issues. I guess I've forgiven but never really forgotten. And it can make some things really hard especially when it comes to trusting he will keep his word. About literally almost anything. I take it hard when he says he will be home at 10 but doesn't come home til 11:30. Last night his friends were meant to come over and drink here and have fun to celebrate an old friend coming to town to visit. He told me at 5 o'clock "were gonna go smoke then go get the drinks and come right back" he didnt come back til 8:40 and was piss drunk and when I asked where he's been he proceeds to tell me all about the great time he had and how he's had 4 drinks already and blah blah blah. Meanwhile I hadnt received a single message that whole time. He was 5 units away the whole time and never once thought to text me. I let it go for then because we had people over and I didn't want to make a scene. This morning I said "I'm really hurt that you were out drinking without me while I was waiting for you and you never told me the plan even changed. It felt really inconsiderate" and he literally laughed and said "you're never happy are you? I don't even get why you're mad" I just gave in and said "whatever we don't need to discuss it I just wanted to say it so I could be honest and not get resentful" he started grumbling about how I'm ungrateful and make everything into a big deal when it isn't. Idk am I causing a problem by saying how I feel? Is it even worth bringing up?