Is this racist?

My boyfriend and I were getting lunch, the waitress asked where we were sitting. I pointed to the table and she didn’t know which one it was, so I said it’s the one next to the Chinese man. My boyfriend looked at me in disbelief and said that was really racist and he can’t believe I said that.

I honestly didn’t think twice, and I wasn’t trying to be racist at all, and maybe it was racist after all. I probably could’ve said its next to the man in the coloured shirt or another distinguishing factor, but I didn’t, so I feel like he may be right.

I totally understand your comments if you want to grill me about being racist and not knowing I am. I do see where he’s coming from, but before him saying it, i wouldn’t have thought about it.