Condom slipped inside

I had sex yesterday with my boyfriend, we were only using a condom because I can't use any birth control right now because of other medicine I'm taking. The condom slipped inside of me, like deep inside of me, I was able to reach it with my fingers though. He didn't finish or anything. I took the emergency pill 20 minutes after. My worry is, I am on my fertile window and ovulation was supposed to take place three days after, would should I be worried of a possible pregnancy?