Has anyone had fertility issues after the use of an IUD?

I had my first child about 16 months ago and my husband and I are going to try again the end of this year for number 2! I have had and IUD in since my first baby and before then was never on any birth control other than condoms and when we tried for number 1, it was super easy (I am very thankful, I know not everyone has it that easy). I was told by my doctor that the IUD wouldn’t cause any fertility issues. Is that true? Has anyone had one and then had it removed and had a pretty easy time becoming pregnant?

Thank you!!