Please help

So I’m on birth control and me and my fiancé had sex. We realized after all said and done the condom came off, we aren’t sure when but he does always try to pull out even using condom and the pill. I normally take my pill between 10-10:30 and tonight it was closer to 11:45, should I take a plan b tomorrow? Or should I not be concerned if any sperm ended up in me?

Update: I ended up taking a plan b pill about 15 hours after, I am too much of an anxious person and am not interested in kids at this point in time. Thank you for your replies, it is appreciated! Also I take a BC pill that you do not ovulate, which I now realize it shouldve been fine. If I wouldn’t have taken a plan b my next 3 weeks waiting for my next period would have been torture I would have been an anxious wreck over it 😅