birth control??

I've been on the pill since January, taking it responsibly every month. I take it for three weeks every day then I stop taking pills for a week. And at that time I'm supposed to get my period. Well I'm supposed to stop taking my pills as of yesterday and start my period.. my boyfriend and I were at a party Friday night and he came in me twice. We've had sex unprotected before a few times while I was on the pill and everything was fine. I'm just wondering since I stopped taking my pills Sunday if there should be any concern? Should I start taking my birth control tonight or just relax and follow my scheduale as per usual??