Not not trying

So, we're officially starting to no longer try to not get pregnant. Not trying to, but not trying not to......advice? Suggestions? He already has a couple kids so he doesn't feel the rush, but......he already has two kids, what if I can't get pregnant? I'm so paranoid and worried it's concerning!