is it me or is it him?

So I've gained lots of weight these past months due to not doing party activities as I once use to along with not smoking cigs. My fiancé is having troubles keeping his sex drive and even   Trying to initiate any kind of sexual intercourse. We tried talking about it because honestly I feel like it's me and my weight gain that has caused the problem. But he claims he wants to talk to a doctor about not being able to keep "it up". He says in embarrassing for him to talk about and has been a problem in the past but I feel like it's either me, or he's seeing someone else or it's actually something we need to look into. 
So my questions is lady's. 
Is it me or him? 
Or another? 
I can't seem to wrap my head around one awnser.