To name her or not to (read full description)

The only girls name my partner and I can decide on is Victoria. I love the name; but it happens to be the name of my brother's ex wife. I'm actually closer to her than him (we've had a bit of a falling out) and I mainly see my niece through her, rather than my brother. They also moved to the other side of the country. My partner says that my brother will get over it (one if his nieces was named after an ex girlfriend he had because his sister liked the name). I would try to discuss the matter with my brother, but he hasn't even responded to the fact I'm pregnant yet (have tried to call him, and ended up messaging him to tell him with a picture of his niece/nephew and never got a response, his ex on the other hand is over the moon and has been helping me so much throughout my pregnancy).

Should we still name the baby Victoria, or avoid it?