Pregnancy Scare

So okay I take my pills everyday.. not always on the same exact time but everyday. My boyfriend recently freaked out because he might've came in me a little bit but he said he wasn't sure.. should I be worried about an unwanted pregnancy?