Low sperm count!!

Leigh
Ok so me and my husband just found out two days ago the reason behind us not getting pregnant. He has low sperm count. I have him on vitamin E 1000 iu/day and he is quitting smoking. But he was on adhd meds as a kid up until he was 17. He took concerta and vyvanse. Can either of those meds also be responsible for him having low sperm count? HELP!