I'm safe, right?

So my boyfriend and I were having sex with a male condom. We're worrywarts, so we were very safe and thorough. Everything was fine, he pulled out, the condom was still attached, no problems, but when he sat up to take the condom off it slipped off. It didn't spill near me and I didn't notice any cum on/in me. It would be REALLY difficult for this incident to impregnate me, right? I think he just waited too long after he came to take it off and it slipped when he started losing his errction, but could it be a sign something was wrong with the condom?