Would you tell anyone?

St
My husband can't have kids so we are using a sperm donor. At first we decided that we were going to tell our families that we are using a donor, but the more I've thought about it I don't want to tell anyone. My main reason is because it shouldn't matter because it's going to be his child regardless. I'm just worried that if our family ever did find out, that they would be really mad at us. Anyone going through this? Any advice welcome