Why does my bf have trouble staying hard with me?

So I have been dating this guy for a few months and we have really good sex. He always makes me cum, however he rarely ever cums with me and he has a really hard time staying hard with me even if he hasn't came yet. Like we could just be kissing and he will be hard but it's like he needs to be constantly making out to stay hard or he needs to be touching me in some way. And I've never experienced anything like that, honestly it makes me feel like shit because he can't stay hard with me and he never cums when we have sex. I have straight up asked him if he's attracted to me and he gets mad that I even ask him that because he says he is. But with the guys I've been with in the past they don't need any help staying hard and they always cum with me. I know I shouldn't compare people but to me it's a bit strange. And he's not old either, I'm 21 and he's 25 so idk if erectile disfunction is supposed to effect people that young. Has anyone gone through the same ?