Morning after pill

Has anyone experienced a late period the in the month after taking the morning after pill? My period came the day straight after taking the pill last month but this month it's late by 3 days. I had unprotected sex once this month but he didn't even finish. Should I be worried ?