Unfair...

So, it seems like my boyfriend gets annoyed when he wants to have sex and Im not up for it. But wait, theres more, he also gets upset when I want to have sex but he's not up for it. Ive tried talking to him about it, but somehow he just turns it over to me. Something like, "You were purposefully making me horny" or "I dont feel good, why cant you understand that?!" Ive been with him for a year now and everything else is wonderful. Just... theres a bit of an awkwardness when it comes to sex.