Too Feminine for a boy?

Daisy
I really love the name Harlow.  
Picking a name has been the hardest thing to do by far. Other names I like are Malcolm, but everyone relates it to Malcolm x which is not why i like that name what so ever. I also like Oliver but everyone relates it to Oliver Twist..
How do I pick a name when everyone has something negative to say about my choices ? Looking for some positive comments and if I would be making a mistake by naming my boy Harlow.  
Other name suggestions also welcome !