If there is no visible sperm/semen on hands, does that mean there’s no sperm/semen on them?

I know this sounds silly but I just need reassurance. I see no visible liquid on my fingers but I fear wiping on the toilet just Incase there is something on my fingers and when I wipe sperm/semen would get into my vagina even though there’s nothing visibly there. If they visibly seem to have nothing on them so, am I safe from pregnancy?