Can using an IUD decrease my fertility?

Em
I'm thinking of switching from the pill to an IUD, but I'm scared that once I remove it after the 3-5 years that it can be in me, that I will have a hard time getting pregnant. Has anyone used the IUD and had difficulty getting pregnant afterwards?