Iud removed ttc

I just had my Paragard IUD removed in hope of ttc. I’m confused because everyone at the office said you can ttc right away after removal, but the doctor said that she recommends waiting one cycle due to inflammation and increased risk of miscarriage if we were to get pregnant during first cycle. Has anyone heard of this or have any thoughts? Thanks in advance!