Feeling heartbroken

So my husband & I have been TTC for almost 4 years. Had 2 miscarriages & our son was stillborn last Aug. He got checked to see why we're not getting pregnant. And the doctor told him he has a low sperm count & probably wouldn't have kids. Now he's given up on TTC at all. Is there anything that can help with sperm count?