Plan B??

I was having sex and my boyfriend finished but I was close so he kept going and when we were done we couldn't find the condom. It was in me! I'm concerned about the sperm leaking out and me being pregnant. Should I be worried? I'm getting a Plan B pill tomorrow.