Should i be worried?

Okay so I've been on the 28 day pill pack for a few months. I just started a new pack this week. But this week the first day i didn't have my pills so i couldn't take them. I first day i missed, i had unprotected sex and he came in me. I figured since it's only a day I'm fine, I'm still protected. The next day i didn't take my pill and we still had unprotected sex. I forget if he came in me that day, he might have pulled out. So i missed my pill for two days. The third day, i took both pills immediately in the morning. I'm a little worried because i know taking the pill on the the first week is important to keep you protected. Should i test?