Is it me?

This is quite a strange topic I know. But I’ve been with my boyfriend for almost a year and from the time we’ve been sexually active, he’s finished probably about a handful of times. We don’t live together or anything and don’t have a car so it is difficult for us to be intimate, however when I give him head it takes like half an hour at least, sometimes it doesn’t even happen. And we’ve only had sex three times (lost our virginities about a month ago) and he’s never come from that either. I’ve asked him about it and he always says something like there wasn’t enough time, he was afraid of someone walking in, and he says he enjoys it still but it makes me feel like a failure. He doesn’t have any problems with getting it up though. He doesn’t pleasure himself either so that can’t be it.

Can anyone shed some light on what I’m doing wrong?