His sex drive low, so is my self esteem

I know there are thousands of couples out there who's sex drives are different, I get that. I want him ALL the time and he is 'in the mood' a great deal less then I am. I don't want to pressure him but I am starting to feel unattractive/wanted. I have talked to him about it and he says he dosent mean to make me feel this way and that he finds me very attractive. However I am not a spring chicken, guys say whatever they want, but I use their actions to tell me the truth. I know he wants the emotional/friendship stuff but I need to feel that I make him hot! I know dating a single mom is not an easy thing for him and the fact I'm 6 yrs older then him isn't always easy either. It makes me feel ugly/old/unattractive. Why dose this affect me soooo bad?