Name issues: Emery

Maggie
We're having a baby boy and I'm in love with the name Emery. It actually was only a male name originally, but has become unisex. A few family members have scoffed and said its a girl's name. I don't want him to be teased. I love the name and I don't think it's girlie. What are your thoughts? (And we're not crazy about Emory...)