How long do you wait before telling for family?

I'm happy to wait 12 weeks to tell the world but I really want to tell my brother and mother in law now. My Hubby keeps putting it off and doesn't seem to want to tell our family until the 12week scan??