Asking for advice/help

So I had protected sex and him pulling out about four days before my period was going to start and I'm now four days late, but I also have always had irregular periods...should I be worried??