Help!!

I just started on the pill on Monday (11/12/17) for the first time ever. I've been taking it at the same tine each day. My boyfriend and I had protected sex yesterday (13/12/17) but but he didn't finish inside me. When then had sex another 2 times shortly after the first (also unprotected) and he still pulled out. I know you should wait at least a week for it to be effective but it just happened. Should i be worried and take plan b?? What should I do??