boyfriend didn't get hard

So yesterday me and my boyfriend decided to have sex. He was a virgin so obviously I took his virginity. So I gave him head first and then we got a condom & started to have sex. Everytime he would take his dick out to change positions it would go soft. This has never happened to me before with a guy. & we had sex for a good 30 minutes which has also never happened to me before. He still never came. I had to leave bc I was running late for a school thing. & ive never felt so shitty in my life. That was his virginity and he didn't cum. He said he couldn't really feel anything w the condom & he said he jacks off a lot but could he just not be attracted to me? :( I've been worrying about this all day. Help