Pregnancy after IUD

I have Mirena now. My SO and I are planning to have it removed and start trying for a baby soon. I'm wondering about the experience others have had after removal, and how long it took to get pregnant.