Help!

Me and my SO have unprotected sex and he goes in me but I am on a low dose of the pill, I take it everyday just sometimes not at the same time. I am a couple days late but have no sign of pregnancy but I haven't had any of my normal period signs either. Should I be worried?