Low sperm motility

We were told by our doctor that my husband needs to lose weight to increase our chances of getting pregnant ..but he claims that is not true and there is no evidence. It's been two years of non successful attempt. What should I do at this point? Close to giving up