IUD Removal & Pregnancy

I had my IUD removed yesterday (yay!). My dr said you’re fertile like immediately & my husband & I had unprotected sex last Friday.

Anyway, I know sperm can stay for up to 7 days in the body. My question is, would that put me in an area to get pregnant like immediately?

Follow up question:: if you had an IUD, did you fall pregnant immediately & have a healthy pregnancy? Or did it take a while?

TIA