Sex as stress relief

I know this is so very common, but I feel as if DH is constantly needing it and I’m just not with it. He gets uptight, annoyed and frustrated so easily now and he claims that’s pretty much his only relief. I hate it because he gets me completely out of the mood with his crap. On top of all that then he’ll really speak to me in a rude manner and say things he really shouldn’t. I don’t know how to deal with it anymore.