high vs low sex drive

so my sex drive is extremely high and my partners is not. he get erect quite often but says he has no control over it(he has said it can happen at any time even at work) but when it comes to us getting down it rarely happens and if he does get erect at home he says"I'm not in the mood, that's just him". we have been together 2yrs and at the beginning he was always up for it. I just don't know what's gone wrong or if there could be a medical reason because sometimes when he wants to have sex he gets really annoyed that half way into it he goes soft.