TTC after previous abortion years ago

Has anyone heard anything about having trouble conceiving after having an abortion a couple of years previous? When I had mine I didn't get knocked out and I'm worried that I was too tense during the procedure and that could've caused something to go wrong. Doctors have told me it's highly unlikely but it's something I've always been worried about. Now, years later, in married and my husband and I are TTC. I just don't want to get my hopes up month after month if this could be an issue.