Skipped 2 pills this pack

So I missed the very first pill of the pack and then I missed week 3 of Saturday's but I didn't realize I did until Sunday around 1:30 am and me and my boyfriend had sex that day and he ejaculated inside me. I took Saturday's and Sunday's on Sunday night but since I didn't take it till 1:30 am I didn't know if it even mattered. Has anyone done this and had a pregnancy scare?