Should I be worried

Kind of freaking out. Last week me and the bf had sex and the condom broke and he had came. Although I'm on birth control I still got plan b the next morning because I had missed a day or 2 that week. A few days later we do it again but without a condom and he claims to have pulled out in time and I'm scared because today I was supposed to start my period. Even most time it will start a day early and Or I sometimes spot a day early but this time it's different. Should I be worried?