Bf uninvites me to a party

Last night my boyfriend was asking me if I would be free to go to a Labor Day party on Sunday. I moved things around and an hour later I told him, “are you still planning on going?”….Then he said “actually it turned into a guys thing.” I asked if it’s just them and he said that it’s a public party but just him and his friends will go together. I’m not upset that it’s a guy thing, but it’s confusing why he suddenly changed his mind about me going. I explained how I felt and he said “are you that hurt about not being able to go?” And I was taken aback by that comment because it wasn’t about going, it was about his sudden change of mind. Am I wrong to be upset about that comment? It’s weird to me he’s acting this way.