He can’t orgasm! Is that normal?

So recently, my boyfriend and I lost our v-card together. So far, we have only done it twice. But both times, he hasn’t been able to cum. We would be working for about an hour, and still nothing. He said it feels good, and he does stay hard, but he just can’t orgasm. I have orgasmed, and yet he still cannot.

I feel like I must be doing something wrong, and I feel completely guilty that I am climaxing and he is not. Is this normal?