Ways to help low sperm count?

Recently we were told my fiancé has a low sperm count and weak swimmers but so far none of our doctors have really been able to explain anything to us because they're not specialized so we are waiting for a referral to see someone who can....so I'm just curious, does anyone know, does this mean we more than likely won't be able to have kids at all? Does anyone know of any ways to help his issue? What really can be done? Looking for people who have been in or are in this situation also...any info would be appreciated :/ I'm worried :(