Bilingual babies

I speak English and my husband speaks another language. We live in my husband’s home county so it’s important that our baby learns that native language (I also need to learn but it’s been a challenge for me). So of course I am speaking to our son in English and he is trying his best to speak to our son in only his native language (our baby is almost 4 weeks old).

Anyone else raised their babies in bilingual households? Did they ever become confused? Does it just come naturally?