Baby name conflict

So, my step dad and I don’t have a good relationship. He was very verbally and emotionally abusive to me growing up. When we told them we were thinking about Weston for our baby’s name he immediately started telling everyone the baby is named after him (his middle name is Wesley). Which was irritating, but my husband and I unfortunately like the name “Westley” a tad better than “Weston” and I’m just concerned about him telling everyone the baby is named after him.. which he will do either way apparently... but I just don’t want people thinking that. I feel like I’m being childish but 🙄. Can’t stand the guy. Am I being ridiculous or should we just avoid Westley as a name lol.