Could I have gotten pregnant?

I had sex with my BF late last night up to around 1 am this morning and we used a condom. In the middle of sex he took one condom off and put on another (he never ejaculated or anything) but I did feel his bare dick accidentally touch my vaginal opening for like a split second. I'm not on birth control. Should I be worried? He's not worried at all and said that nothing would happen. But I'm tempted to just take the morning after pill just to have peace of mind and not have sex until I'm on birth control along with the condom. Please any help would be great!!