Help! Ex opioid addict

My husband has been sober for 5 years he used to have a opioid/ pain pill addiction then was on methadone but now he is clean clean. He vapes now only (not thc). We have been ttc since August 2019 and no luck yet, we both been to doctor and no issues that we know, do you think his past is a reason to why we have not been able to ttc? anyone elses partner had this issue and been able to have a baby?