HPV and cryosurgery

When I was 18, a few months after I got married, my pap came back abnormal and was told I had HPV. I had the cryosurgery procedure and thankfully 6 months later I no longer had any precancer cells on my cervix. My husband and I have been ttc on and off for 6 yrs now. Recently I read an article that cryosurgery can cause infertility due to scar tissue. I've gotten regular paps since and they have been normal but haven't had a thorough exam. My husband says he just wants to keep trying a while longer before we go to a fertility dr. Has anyone had a similar experience? What did you do? Sometimes I feel so alone since no one I know has ever gone through this.