Sex is always on his terms.

My DH and I have a very different sex drive. I'm pretty much ready to go whenever, and have never turned him down when he initiates, however when I try to initiate he turns me down majority of the time "I'm tired" "I worked a long day" "I don't want to hook up right now babe." I feel like the sex is also pretty one sided, like I told him then other night I only orgasm maybe 10% of the time, the other 80% the sex is over in like 10 mins and he's done. I'm very vocal with him on how I'm feeling, yet nothing seems to change and I feel close to just withdrawing. Any advice on how to get through to him, or is he just being selfish when it comes to sex.