baby name change?

I wanted to call our daughter Charlotte Mae, I absolutely love the name and have been saying so since we started ttc. My OH has a son to a girl he had a drunken fling with and when she found out the name she started saying "oh just like the girl that introduced me and you to each other" now I'm so put off the name!! My oh has said not to let that put me off but it has :( is it pathetic to be put off for that reason? lol any cute baby girl names? I like unique names too  :)