How long to wait to have sex?

How long to should we wait between having sex while ttc, for his sperm count to go back up?