Controversial Baby Name

So I am African American and West Indian, the father is Costa Rican and Belizian. we decided to name our boy Connor and it really bothers me that everytime I say what his name is people look at me like I'm crazy. Or I get that look like oh, it's doesn't fit me ( my color) makes me think maybe I should change his name. people have actually said thats a white boy name,he's black I don't like it. like seriously ? it's a name. and it's a cute name it shouldn't matter what ethnicity he is.