Am I to sensitive or would you dislike this too?

I was talking to this guy and it irritated me deep in my soul that he would say “you’re not a priority”. I don’t know if it’s because his first language was Spanish (he’s fluent in english tho) or what but that was his way of saying he does like me but not in love with me yet. I’m not talking to him in a romantic way anymore because of this. I feel like that’s so rude to say and when I called him out on it he said “well it’s true”. Would you find this to be rude too? I know it’s just words but damn I feel like he could have said it nicer