Am I dumb?

If I give my boyfriend a blowjob, and a few hours later he wipes off his penis and then we have sex with a condom should I worry?