He can’t get fully hard or he can’t get hard at all

I started seeing this guy recently and we’ve had quite the connection. On the fourth date, we had sex twice. I noticed that he was partially hard but not completely... just enough to penetrate and get himself off ( I finish too). Later that night he mentioned that we have good sexual chemistry , and I felt the same way. Went on a fifth date today, and we did it twice. Or at least tried to. We went for a first round, didn’t get completely hard but did the work for both of us. Then he asked to go for a second round in which I agreed to. I got on top and he went soft .. then he said it’s better if he was on top, so he went. But he didn’t even get partially hard and I’m sure he didn’t finish , whereas I did somehow. He went to the bathroom and I’m pretty sure he finished in there. I don’t know.

I’m starting to think it might be a me thing or if I should even bring it up to him. Any advice ?