Should I be worried?

Me and my boyfriend had sex while I was on birth control with no condom. I just got on my new birth control pills 5 days ago and I’ve been reading they don’t work till 7 days in. He pulled out still but i don’t know if I should worry or not.