How long do you wait before telling for family?

I'm 6weeks gone and so excited. We haven't told any of our family members yet. How long do people normally wait?? 
I'm happy to wait 12 weeks to tell the world but I really want to tell my brother and mother in law now. My Hubby keeps putting it off and doesn't seem to want to tell our family until the 12week scan??