Don't want to have sex

Do any of your ladies sometimes feel like you're always the one initiating sex? 
A few nights ago I tried to have sex with my husband and it was like he wasn't into it at all and by the time we were ready to have sex he wasn't hard anymore...this isn't the first time it's happened and he always gets upset because I get upset because it makes me feel like it's my fault and that he's not attracted to me. 
And now tonight I tried to initiate sex and he made the comment "well we have to get it to work first" and then went back to what he was doing. I feel like I'm always initiating sex which makes me feel unattractive. We've had talks about it before but it keeps coming up. 
Anyone else had this problem?