Sex drive ruled by cycle

I have such a high sex drive during my period and ovulation (hurray eve app for helping me see that!) but such a low sex drive every other time. I feel horrible because my guy will want to get things going and I'll turn him down because even basic stuff is boring or even painful if I'm not turned on enough. Does anyone else struggle with this? He's always ready to go and I'm always on a roller coaster! Just wish I could be more available :(