Am I selfish?

Last well for lunch we went to my boyfriends restaurant choice (which I do like) before we left we talked about going to my restaurant choice (which he says he hates) eventually I gave in and he promised we would go to my restaurant this week.

Well today is the day and now he’s saying he doesn’t remember promising and it doesn’t matter because it’s selfish of me to ask him to go somewhere he doesn’t like and it shows I don’t respect him.

Am I wrong for being disappointed, I feel like once in a while we should go where I want to go.