New to the pill

Today I had sex without a condom for the first time. I started taking my birth control pill on the first day of my period five days ago. I will take pill number six tonight. Even though the instructions say I'm protected, I'm so freaked out!  Is there a need for worry?