Am I Too Into TTC?

I haven't truly been TTC with my boyfriend, but we certainly don't take any precautions to not get pregnant. He and I are perfectly okay with the idea of me becoming pregnant! But since the beginning of us having unprotected sex, my body has changed and although having had my period the past few months, I've taken at least 12 bct's. Maybe I'm going crazy, but a few weeks ago I went to my doctor for my annual checkup and they told me that I have abnormal cells down there. They told me not to worry, but now I am, because it could be anything and of course I read something about it possibly leading to infertility... Wondering if it's worth worrying about or if I'm just freaking out over the idea of not getting to experience pregnancy? Should I go to a fertility specialist?