Late Period

So I'm a couple days late of my period. My periods are a little but irregular but I feel like I should have had it by now. I took a pregnancy test and its negative. I've been using protection and our condoms haven't broken that we know of. But I'm still worried even though the test was negative. Should I be worried??