Do I have to take the placebo pills?

I’m on the combination pill and I missed 5 out of 7 of the placebo pills last week. I’ve had sex once without a condom and he pulled out. I take the active pills perfectly. Is there anything I need to be worried about? I’m just worried.