Should I be upset ?

So recently me and my boyfriend were talking about whether or not we'd like to go to prom next school year and he told me he didn't want to go because he didn't like school dances, and I said that I wanted to go because I've never been to prom. I got upset at the fact that he doesn't want to go with me but when he was with his ex he took her, am I over-reacting or should I be upset ? I know I should talk with him about how I feel but I don't want to cause a fight if I'm just being dumb.