When is it ok to take newborn out in public?

Right now we have kept our newborns exposure to public places at a minimum. He is one week old and a couple days. I know keeping him inside is what’s best to protect him against germs and illnesses but some days are difficult for me because I’m used to going out and doing what I want to do.

So that leads me to be sad and down when I can’t go outside like I used to. Idk if there’s an exact age everyone started to go outside with their newborn? It’s also hard because my bf’s family keeps insisting the baby has to stay inside for now and I really dislike that because in a way it’s like waiting for their okay to take the baby out and only god knows when that would be. Who knows maybe they’re planning on saying the baby has to stay inside until he is one years old. So any recommendations as to when baby can go out in public?