Late period!!

I recently got the xplannon removed and started my first birth control pill pack, and I'm on my sugar pills currently but haven't started, making me 6 days late.. Negative pregnancy test though. Should I be worried??