How to deal with people judging your baby name 😒

We have chosen a bit of a unique baby middle name for a boy but it's something my boyfriend and I came up with together. People keep telling me I'll regret it or I'm setting my kid up already but a name is just a name. I think it really comes down to how you raise him or her. I end up either getting defensive or annoyed, bottom line it's not you're baby 😒. Anyway I notice it's making just avoid saying his middle name all together 😔. Any advice