Telling family

My brother and sister in law have been ttc for two years with no luck. I'm now 5 weeks pregnant with my 3rd baby. I'm terrified to tell them. It will break their hearts. I am actually getting anxiety about it and nightmares. I'm afraid the stress of it will hurt my baby. I told my husband that I'm never telling them! Which I know is ridiculous. Any tips would be appreciated.