Is it me??

Okay so I'm my boyfriend and I did stuff for the first time yesterday. We didn't go all the way but there was a lot of oral and such. He didn't cum even though I gave him a blowjob like 4 different times... he said it was good but didn't finish. Today he told me that he never really got close to cumming. I feel bad now and I don't really want to do anything sexual with him anymore... I made my ex finish. I'm not sure if it's me or him....