Initiating sex

My boyfriend doesn't like to initiate sex because he said if I ever turned him down it would destroy his self esteem. I even told him that I would rarely ever say no to sex. So basically I initiate all the time. I feel like even if he doesn't want to do anything he still will just because he doesn't want to say no to me, and that makes me feel bad. Also I have a very high sex drive compared to his previous partners so I feel like I might be asking for it too much (if that makes sense) anyways, does anyone else have a partner like this? Do you have any advice about something I can do?