Is there something wrong with me?

Me anyways. He always makes sure that my needs are taken care of, but in the weeks that we have been sleeping together he has one been able to finish with me once. Other than that I have to finish him off by hand. This is fine but it's starting to make me feel as if I'm not doing enough to help him finish during our time together. There is also a couple of times that right after the foreplay and before we start the actual deed he goes completely soft and we have to fluff or can't get it back up all together. I have talked to him about it and he says it's because he is tired or because he has been with a woman in a couple of years. Anyone else have this problem with there lover and what tips and trick could I start to use to help him get up and stay up and finish with me?