letting our son choose our baby's name

So I'm currently 22 weeks pregnant with a boy and we already have a son who's going to be 6 years old in feb 2017, since the first day we told our son we we're having a baby he's always said it would be a brother (he was right) and he was going to call him Jeffrey, would It be mean to call our son this, we live in Bristol in the uk and our accent isn't great so all I hear is 'r jeff'!!🙈 would this child grow up hating his name and hating us for letting a 6 year old name him, please let me know your thoughts the name Jeffrey.