Early?

I've only been on the pill for two going on 3 weeks tomorrow. I had sex yesterday with a condom and without one for like maybe a minute (literally) but then my guy pulled out and finished so he didn't cum in me. I should be okay right? I know, I do worry but I've heard that after the 1st 7 days of taking the pill you don't need a condom and some people say it takes a month, but my leaflet said 7days