Sex without condom but on birth control

I’ve been on the pill for 3 weeks and my boyfriend and I had sex without a condominium for the first time, he pulled out plus my doctor said the birth control would be effective 2 weeks after taken so do you think I don’t have anything to worry about? (It’s the first time without a condom so I might just be stressing myself out for nothing) plus, I know there’s always chance of pregnancy because birth control isn’t always 100% effective, I’m just asking in general if I have anything to stress over. I’ve been taking the pill at the same time everyday & haven’t missed a day.