why am I always worried? Plan B

I didn't take my birth control for two Days! But my pharmacist said to take two for two days and I'll be on track and to also use protection while having sex.. We did use condoms & he didn't cum inside. One of the times we had sex the condom came off.  But he didn't cum.. Should I take a plan B just in case?