bilingual homes

A
Do you speak to baby in both languages? Or mom one language and dad the other? Im wondering because at my appointment the doctor mention that it can cause confusion and sometimes speech delay. He said to only speak in one language