is it wrong to say this

Last year I went with my boyfriend to his fraternity's formal. I live out of state so got to fly up for what I thought would be a fun weekend for us. Well he completely left me the entire night to be with his friends and drink. I'm a lightweight and know when to stop so I quit early on but he's known me for years. When I found him he was outside smoking cigars. So I figured instead of sitting at a table alone on my phone I should stand by him. Well me in heels, a dress with no sleeves, and a cold night don't mix. I asked to borrow his jacket and he said no he's cold and with his friends. Well after the party I told him how I felt and all and he apologized. Well now he's asking me to come this year. I want to tell him if he can't make a priority and spend time with me then to just to alone. Is this fair? I paid $300 for a flight to be with him last year and honestly it was a waste for the amount of time I got to spend. What do you guys think. I know friends are important but  if he can't bacalne me and them then don't invite me. Am I right? Also I knew absolutely no one there and wasn't introduce either. I'm not trying to be bossy just that if invite me and I spend my time and money I expect to be included and not feel left out.