Beyond frustrated.

My boyfriend and I have been together for a while now, but when we first got together he was a virgin, and I was not. In the beginning he was only lasting a couple minutes (if even that long) but I didn't mind much, assuming it would get better with time. Well, it has been some time now, and he is still only lasting maybe 5 minutes MAX. He is the best sex I've had, just wish I had more of it. It's especially frustrating because this is the first time I've ever felt like I could actually get off with just penetration, but it's not a long enough time span for me to actually get there... we're having sex 2-3 times a day, but he's the only one getting off, and at this point I don't even want to do it anymore.. it's not even worth the hassle, nor the energy. He says he'll try to work on pleasing me more, but doesn't. He doesn't finger me, and never gives oral. We've even tried using condoms/condoms with numbing for him, no luck. I don't even enjoy masturbating anymore, so I'm just really sexually frustrated, which is making me bitchy towards him. Don't know what to do..