Middle name

Hey so my niece has jade as her middle name, we want to use jade if we are having a girl (find out in 4 weeks) my sister in law doesn't have a problem with it but my hubby's brother does. He said there are plenty of other names and we don't need to use it. 
Jade is my ultimate girls middle name, all our other children have j middle names and my other daughter has jean (after hubby's mum) , there aren't that many other girl j names that suit being a middle. My husband said if we want to use it we will but I don't want to rock the boat. 
Thoughts?