can't believe my boyfriend want to take me to the same place he took her

Yareli
My boyfriend and I had a discussion today he got mad at me because we are going to vacation trip for this weekend and he asked me to stay in hotel  I tell him I don't know I never stay there before and I asked him how do you know about this place and he said that he been there before with his ex (a girl he date after me the one he cheated on me)and I told him not to take me there I know that what it wasn't in my year I don't have to worry about it but to be honest I feel uncomfortable 😣 cuz he cheating on me with her. Do u think I did wrong to tell him and let him know that I don't want to be at the same place he took her ? And I don't want to be any place he took her cuz it hurts me? 
I normally don't say anything about things like that but just to think that they were together in the same hotel makes me feel so sad 😭 I just want to stay home and cry again