I get mad when my boyfriend won't have sex with me

Is it bad that I get mad when my boyfriend won't have sex with me? I constantly crave him. Even if I'm not wanting sex I never turn him down so why does he do it to me?