Wondering what is wrong

So I have been married for five years my husband is not my first, but I was his. When we have sex I have to literally jerk him off for about 5-10 mins before he is hard And then sometimes halfway through sex he loses it... I have never heard of that happening, and normally a little bit of fore play was enough for things to just happen before.. Anyone have any idea what could be wrong?