pregnant?

hey ladies, my period is 4 days late. my bf and I didn't have sex while I was fertile and when we did have sex he never came in me, although we didn't use condoms. should I be concerned about pregnancy?