Should I be worried?

Hi everyone so I had unprotected sex for a little bit and he made sure to take it out every so often to wipe himself and we were careful. Well I started to change my mind and asked if we can wear a condom and he changed into one. I took plan b the morning after, should I be okay? Thanks.