Depressed

I have been getting so upset at my husband about things lately, that it literally makes me physically hurt. He RARELY wants to have sex, & when he does, it's when I'm really tired. He almost always finishes before me, so I'm left with "blue balls" & even more unsatisfied than before. He seems to be less affectionate lately & it's like he doesn't know that I'm upset unless I repeatedly tell him. He tries to give me excuses like, "I didn't know you wanted to have sex" when I asked him to come into our bedroom & I was laying on the bed naked. Or tonight when I sat in his lap & kissed him for a few minutes & then motioned for him to follow me to our room, he said "he didn't see me" even though he was looking at me. I have talked to him about this so many times that I just feel like a broken record & don't want to bother him with it anymore, especially since when we do have sex, I almost feel like it's pity sex. I know that he's not into sex as much as I am, but it's really important to me (self esteem, the intimate connection it gives us, etc) & is how I release stress because I have no friends or hobbies (we have a 1 year old so I don't have time, but I make sure he has time to enjoy his hobbies). He really is an amazing, father & husband, outside of this issue (&occasional; in law problems). I just need some support & to get this out. I don't want to leave him or anything, but I get so unhappy sometimes because of this.