Should I be worried?

Emily
My boyfriend and I often have unprotected sex and use the pull out method. I know it's highly unlikely, but my period is 4 days late, and I'm beginning to worry. 
How many days of missing/having a late period until I should begin to really freak out?