Just checking!

Hey ladies! So, I started the pill exactly a week and a day ago and my lady doctor told me that it would be effective two weeks in. I think you can see where this is going. Last night my man and I were fooling around and he asked whether he should use a condom or whether we were in the clear. Knowing that it was two weeks to the day, I said he was okay to go in bare, but now I'm having second thoughts about whether that was completely smart. Should I be worried or am I fussing over nothing? I've been very good about taking my pill at the same time so far, if that changes anything. Thanks, guys!!!