Help me!!

I'm 17 and recently I got on birth control about 6 months ago. Well last month I lost my packet and had to skip it. Well my boyfriend and I were having some fun and he never put his penis in me but he fingered me a few times. Would it be possible to miss some sperm when he wiped his hand off and then got the sperm in me. I only say this because I missed my period and I don't know if it's irregularities, amount of stress ( I have anxiety), or that two days after that night I found the packet and took two just in case. I'm afraid I'm pregnant. I know this is stupid, but could someone please help me.