When to announce ?

So we did <a href="https://glowing.com/glow-fertility-program">ivf</a> and I just had an ultrasound 5w5days doctor said everything looked fine. My husband wants to tell all his family but I feel it’s way to soon. Any advice ?