Newly married and not wanting a baby

So I'm on birth control, we've been using a condom, or he's been pulling out. But we really want to go all natural and not worry about pulling out.im staying on the bc, and  if it's on one of my days where I'm supposedly "not fertile"....how safe is it? We just don't need to get pregnant right now.