Pregnant first cycle after IUD removal?

I had my Skyla IUD removed on April 25 and got pregnant the first cycle after (ovulated May 11). Currently 4w4d. My OB told me at my removal appointment to wait one cycle before trying, but I obviously didn’t listen and can’t find good information about why to wait a cycle other than for dating purposes. Has anyone been told to wait just one cycle? Why?