My boyfriend hasn’t finished...help!

okay so I’ve been dating my current bf for a couple of months now and we’ve had sex about 4 times. The first 3 times didnt last very long bc of family coming home and other things (so he didn’t end up finishing) but the most recent time lasted about 25 minutes. It felt really nice for me and was honestly great but we ended up stopping. I thought he finished but I asked him if he did and he said no. This made me feel extremely self conscious and upset. I asked him if he enjoyed it and he said yes. But deep down it really upset me and I havent stopped thinking about it. My previous boyfriend would finish in under 10 minutes, most of the time under 5. (I know everyone is different) Is it something with me? Maybe he just goes for a long time? I don’t know. Do you think it’s something I need to be worried about?