Sex after a couple if hours of sex

Since I'm in an LDR, I visited my bf for a weekend and we had sex pretty much 5 times in less than 48 hrs. The thing is we would always start without a condom but he would always put one on to be safe and finish in it. I'm not on BC so I'm worried that when we had sex hours later, there would be a possibility that I could get pregnant from potential "residue" or sperm from the previous intercourse. Is that possible? It's not like he came in me and it's been a couple of hours.

Hope that makes sense!