When should we announce our pregnancy?

Me and my SO found out that we’re pregnant w/ our first and I’m 4 weeks, so this Saturday I’ll be 5 weeks. I wanna tell our families that we’re expecting on Mother’s Day but he saying it’s too early. I know it’s early as well but if anything happens, god forbid anything does happen I want support as this would be our first.