Slipping off?

Me and my bf were having sex but i got up really suddenly and the condom slipped off and stayed in my vagina, the end was still out and i didnt realize. My boyfriend took it out carefully and said that nothing spilled of leaked, plus he didnt cum and we stopped after that. It was a spermicide condom and it wasnt my "fertile" week. I should be okay right?