Middle name husband “hates”

I really really really want to use a family name on my moms side for our baby’s middle name if it’s a girl.

My husband “hates” it and thinks it’s “ugly”. But then also thinks middle names don’t matter because they’re not used anyway... so I’m like... why should he care then?

We basically never use our 4 year olds middle name.

It’s on her birth certificate and health card but that’s pretty much it!

Would you use the name?? It’s a family name that goes back generations on my side, one I always thought I’d use as a first name some day.