Thought on the name "Emerson" (Boy)

My husband and I are having a difficult time agreeing on names. We've both said Emerson could be an option. I like it, and it's continuing to grow on me. My concern is that it seems to be more popular as a girls name. I'm going to sound hypocritical but I'm ok with boy sounding girls names because I think they can pull it off more than a girl sounding boys name. What are your thoughts? Middle name would be Alfred, which is my husband's name and a family name (didn't want to name out som Alfred... the third).