Baby name! Help!

Hi ladies! So my husband and I are completely stuck on these baby names. My husband's grandpa's name was Carl Lyle, and my husband adored him and would like to honor him by naming the baby Carl. But I'm definitely not sold on that name. So he suggested Carlyle. I'm still not sold because I think everyone will just call him Carl. Our other option is James. It's a name that we both like, and I like a lot more than Carlyle. However, I feel absolutely awful ruling out Carlyle because I know my husband and I know how much he loved his grandpa. Any advice is appreciated!