Birth Control Pill

Hi! I have been on the pill for a year and have only taken it late (1 hour 30 mins late) one other time. But tonight I forgot it at home and was 2 hours late on it. My boyfriend pulls out but we don't use condoms. Should I worry about it or no?