it's not personal

My man is deeply offended and gets angry when I don't want to have sex with him. I know he knows it's wrong and doesn't know why he feels that way, and I don't know how to explain to him that it isn't personal, because just saying "it's not personal" isn't doing the trick