Baby Name- Using Sibling Middle Name as new baby’s first name

Shea

We didn’t find out the sex of baby number 5, and we have a girl name, but are conflicted on a boy name. My last daughter is Lucy James, named after my father in law. We love the name James and contemplated it as a first name and using the middle name of my grandfather. We would call the child. Yet the first name James. Is this crazy to do this? I have several other names too, but seems like we don’t really agree on the others as easily.