won’t wear a condom?

okay ladies so i was hooking up w this guy and he wanted to have sex so we drove to the gas station and got condoms after i said not unless you have protection. we got back and started having sex with it and he stopped about 20 minutes in and said he can’t get hard with a condom. like he was hard but then got soft. we did have sex without a condom after (i know bad idea yes) but i’d really like to see him again. is this a common thing or was he just saying that? i am on the pill and he pulled out but i like the safety of a conform.