Pre-cum on top of condom, accidentally

If a condom touched the pre-cum and he turned it over to put it on correctly (he didn't unroll it just realized it was the wrong way), would that be something to freak out over? He doesn't understand why I'm a little nervous. I know he hasn't masturbated for a couple days, and before we started making out, he did pee a couple times throughout the day (maybe 20 mins before too).

I'm nervous because I was just entering the fertile window. The condom itself after was good, there was no leaks.

What's everyone's opinion? We always practice safe sex, it was just at that moment and I didn't think much of it.