Wanting to wait to announce pregnancy to family in person but will be ~19 weeks by then. Too long to wait?

D
Sorry! This is going to be LONG!! 
So, we just found out I am pregnant this week. I am exactly 6 weeks today. My husband wanted to tell someone so we can ask advice but not necessarily tell everyone about everything in case of a miscarriage (there would be lots of "drama" and not lots of support if we told too early and that happened, so not worth it to tell whole family). So we told my parents so that we can have someone to talk to (my parents have 8 kids, said be set of twins in there, have had more than one miscarriage, my mom had to have an emergency c-section and they have 19 soon-to-be 20 grand kids. We felt like they could be a good recourse no matter what happens because of their experiences! Plus, they are good at keeping things to themselves when asked!) My husband and I both want to wait until at least passed the first trimester to tell his parents and all of our siblings. (His parents are notorious for not being able to keep things to themselves and the "drama" I mentioned earlier would come from certain siblings on both sides!) Our families are in different states right now because of where we are both from (met at college out of state) and we are now in a new state again for him to go to grad school. I personally want to wait until we can see our families in person to be able to tell them because I think it would be fun and we can do something to make it kind of memorable since it is our first one, we have been married for a while and have been trying for a while and we are the youngest and the last ones ones to have our first baby on both sides of the family. But by the time we can do that I will be 18 weeks and 20 weeks when the summer family reunions come for both sides. I think Hubby just doesn't want to wait that long and uses excuse "What if someone wants to give us something before then and if we don't tell them, then they can't do that." I don't know if it is just my "pregnancy Brain" starting to kick in, but I can't think of any reason why someone can't give you certain things passed 20 weeks??? I really just think he is excited and doesn't want to wait! Can't blame him! I'm really excited too! But I also know he gets way too excited for things and can't keep his mouth shut. (I always get presents early for things because he is too excited and I get hints the whole time without asking because he is too excited 😜) 
All of this explanation is leading to these questions: In hopes of making it "special" by waiting to tell to everyone in person, would it be mean to wait that long to tell for any reason and therefore not be what I hope for in terms of making it special/memorable/fun? Also, would it be unfair to hubby to make him have to try and keep this secret that long? I know he can make through first trimester, but can he make it a few more weeks? 
I would like some opinions! I can see both sides, I can see potential problems, (I.e. Hurt feelings for not telling sooner). But I can also see it being so fun to tell everyone in person!