Late period

So my period isn't always on time but I'm 3 days late should I start to worry about being pregnant?