Early each month?

So my period for the past few years has been on a constant 25 day cycle (sometimes plus a day if I'm stressed) but the past 2 months it's coming 3 days early. Last month I had taken Plan B, I thought that could have caused it to be early. This month, I had unprotected sex on my peak day, we used the pull out method. This month AF came 3 days early... should I be worried?