gender reveal

Erica
Hubby announced he wants to do a gender reveal party with those we are close too as he's never heard of them  until the other day and we never even had a baby shower with first two and this is our last ... He wants to make the pregnancy special....However he wants to invite my sisters and mother.my family is super judgmental of our friends already and he's looking to invite people who will drink and have a good time and don't care what they say or who they say it too... This is a recipe for disaster. I also don't want to deal with my family as I don't get along with them.... The dilemma is if they find out they weren't invited it will be the mother of all guilt trips. They live close by and have been known to randomly drop in 😩 I'm ready to scratch the entire idea just to avoid drama but he's pretty adamant.... We have a couple months before we would even have one but I'm already stressing it... Suggestions on how to minimize drama/stress?