Should i take plan B if I’m on the pill?

Okay I need input.... I’ve been taking my birth control pill for 2 weeks (same time each day, haven’t missed one) and today my S/O didn’t pull out. My doctor said the birth control starts working after 7 days. Am I freaking out for nothing? Or should I take the plan b? What would you do?