Help :-/

I don't know what to do. I'll start with a little background.... When my now husband and I first became involved there was A LOT of sex. Both of our sex drives were high and steady. Now (about a year and a half later) mine has gone down a good bit because his is just unrelenting. Lately he's been getting really frustrated about it. Like, we do still have sex but I rarely initiate and honestly sometimes I'm difficult about it because he doesn't tend to put a lot of effort into turning me on even knowing my libido has dropped. I keep trying to tell him it's nothing personal I'm just not horny. He can't seem to not take it personally. He says I've been 'dangling it over his head'. And it's 'not fair' because when I do want to have sex it always happens. I'm sorry if this is jumbled up lol. I feel bad because I know I'm making him feel bad. But is it really too much to ask to want to be aroused? I just don't know what to do anymore talking hasn't helped.