Ovulation and CM - help!

I (26f) had sex with my (28m) husband on 6/19. I just stopped my period two days prior. This is the first cycle I've used OPKs to help track my ovulation so I wasn't sure what to expect. My opk was very negative and I had dry/tacky CM. This remained the case until Sunday afternoon. Yesterday (6/23) afternoon I tested for my first surge, I believe, and am assuming ovulation has started or will start soon. We didn't get a chance to do the deed more than once five days ago so my question is, would it be possible for any sperm to stick around through 3ish days of non-fertile CM and catch my ovulation (~24 hours from now)? I've done as much research on Google as possible but nothing that answered my specific question.