Fertility drugs after iud

I just had my iud removed on the 18th by my onocologist and now have an appointment with my OB on the 27 to talk about taking fertility drugs to get pregnant. I don't ovulate like I am suppose to. Question is has anyone been through taking fertility drugs right after iud removal? Did you have to wait a certain time frame before starting them? My onocologist does not want me to wait to long because of my situation. Can anyone help me??