Is this normal?

The last few times my so and I have had sex he hasn't been able to cum and it's made me feel really self concious, he'll suggest I use my hand or mouth instead after a while.. Am I stressing for no reason or should I be concerned?