skipped sugar pills

this month i skipped my sugar pills, and just didn't take any because they have no hormones so i didn't think it would make a difference. i got no period and had sex during the break week. should i be worried?