Worried

I take birth control pills, my doc told me to stop for a week after every three weeks from taking them. I just started and am on my fourth week, which means I’m on the week that I should stop taking them. My bf came in me and now I’m about to take Plan B. Should I be fine?