When to go back to church

Our church is taking new members this Sunday and my husband and I really want to join. Our LO will be 3 1/2 weeks old and our pediatrician said as long as we keep her covered and minimize people interacting with her that she SHOULD be fine. My husband thinks she will be fine, but I'm not sure I feel entirely comfortable yet. I just know everyone will want to see her.