Help?

I was off my birthday control for about two weeks due to health issues.. I just started taking it again last Friday and my boyfriend and I had unprotected sex on Sunday.. should I be worried about getting pregnant or am I ok? I think I might be to late for the Plan B pill