messed up my birth control

So I am married and we have regular sex. He finishes inside of me every time since I am on the pill. I am in my third week in and just realized I must of missed a day because I am one day behind where I should be. I am guessing it happened a while ago because I don't remember missing one lately. What should I do? and should I worry about being pregnant?