TTC and now abnormal cells

I was meant to start Clomid in a few days and I was so excited to start it. My doc rang me this morning with my smear results and said I'd abnormal cells and some swelling of my cervix. I'm gutted and freaked. The doc said I could start the Clomid as I was meant to and I said are you sure that's a good idea. Should I not wait to have these cell changes removed and further checked first and then he said ok you could do that to. Confused and feeling down now. Help 😪