Worry or not

I recently had sex on Sunday with a condom. But I keep forgetting to take my birthcontrol. Should I worry about it?