Couldn’t get hard

So me and my new partner were trying to have sex for the first time the other night. Everything was great. But he put on the condom tried to go In and it wouldn’t work. At first I thought it was my lips. (TMI I think but I usually hold them open bc sometimes they get in the way.and end up getting pinched) But I could tell he was soft and In my mind was “I don’t feel anything” but I could feel his fingers when he was playing. We took a break and he went down. No problems there. He listens and does what I ask. But he went soft again right before entering. It’s not a huge deal to me because it was the first time for us personally. I know anxiety and nerves can get in the way. He was amazing with oral and his hands. I was so close but I couldn’t relax enough. Is there anything I can do to help him not be anxious or nervous? He kept apologizing and he didn’t have too. There was no reason. Shit happens. We cuddled in bed for a while. And then went back to the couch for another movie. We still made out and cuddled after the fact. But I could tell he felt bad. I had a great time! It was our 4th date. We’ve known each other for years so it’s not like we’re Brand new. We’re hanging out again next week. He works nights and has week days off. And he asked if I wanted to stay the night! And I totally will! He’s super sweet! We can be goofy together and I feel like myself around him! But I would like to know some advice on how to make him more comfortable sexually? So he’s not anxious next time. To see if that helps. If it happens again. It’s not a big deal to me. Like yes, I want to sleep with him. But I also get sometimes things don’t work the way they want. Anything?!