Would you stay in a marriage where you didn't feel desired?

I don't think my husband is attracted to me as he doesn't have a strong sex drive possibly due to low testosterone. He has never really had that strong aggressiveness you know " I need you! I have to have you" sense about him. He is very traditional like it always has to be in the bedroom. Hardly ever spontaneous! He has made comments about my body that he encourages me to lose weight etc. I'm 5'4, 160 pounds. I for sure don't turn him on being naked running around the house. I can tell as he doesn't really check me out in fact I feel like he avoids looking at me. He is only attracted to me when I lose weight. He has also made rude comments to me when I have been depressed etc. I'm having a hard time getting over the time when I told him I'm having a hard time concentrating and needed his input on how to respond in a email. He lost his patience with me and said "It's like you are so incompetent!" He regrets saying that now after I tell him that its hard for me to forgive him or move on from that comment. Seriously...How can he really love me? Is he just afraid of starting over and being alone? If you're not into my body or you don't even believe I am intelligent...why would he want to stay married to me?