Not telling his family? Need opinions

Im 13 weeks pregnant with my second child and also second boy. When my husband and I found out we were having our oldest (now almost 2) all his family said was "really another boy," because his sisters already each had a boy and there wasnt any girls yet. They never wanted to attend baby showers and they never visited after he was born we assume because he was the third boy for them. (We think this because one of his sisters just had a girl and everyone was over the moon about it) now that we are pregnant with our second who happens to also be a boy, my husband doesn't want to tell his family because we don't want comments about how theres too many boys between him and his sisters because this will be the 5th boy out of 6 grand children for his parents. We are honestly very happy to be having another boy. I personally feel weird about not telling his family but I still don't really understand his relationship with his family even after so many years. Would you be alright with this? Should we tell them?