He can’t stay hard?

Hello everyone, I need advice. I started seeing this guy and we started hooking up after 7 months of getting to know each other. I had a relationship before and my ex bf and me never had trouble in the bedroom, he would satisfy me and I would feel good we never used condoms because we trusted Each other and I was on birth control. This new guy I wanted to use condoms and as we started to get into it I noticed he was having trouble staying hard and we couldn’t even get it inside of me.. he got frustrated and threw the condom and went away I talked to him after and asked him what’s wrong and he said he didn’t wanna talk about it… idk if it’s me? Maybe I’m unattractive to him.. or idk.. has anyone have this issue? The condom really makes me super dry and it hurts trying to put it in when it’s not hard..