Trying to get pregnant.

So my SO and I want to start/expand our family. He has three kids and I have two but we want one more. We have been trying, but I think I can't have kids anymore due to being exposed to who's knows what In the military. And he thinks his swimmers are dead or not swimming fast enough. We talked about what if we can't have any more kids. He wants to just be happy with what we have. I really want to have another baby. How long should we try til we give up?