Naming issue !

Ma
My SO was married before and had another serious relationship before we found each other. We are TTC baby #1. We have discussed named and he wants Skyla for a girl which I adore. My issue is he said he's wanted that name since he was a teen. His ex wife had mentioned the name before. I don't want a baby name he had planned with another women. Am I being unfair, or crazy? How do I deal with a strong minded man on this topic ?