Pre-cum worries

Last saturday, I was giving my boyfriend a handjob while he was fingering me. He wasn't really that lubricated but I still had some precum on my hands, altough very little. I put my hand over his as he was fingering me and then after I touched myself in that area to adjust my underwear. He had also touched himself to adjust and then proceeded to finger me. I'm worried about the precum but he had peed shortly before this happened and he never came either so I know there shouldn't be any sperm in the precum. Our hands also rubbed on my jeans and underwear before getting to my vulva but my anxiety is still peaking, should I be worried?