Too much pressure???

My husband says he feels pressured when I say my days of a higher chance of getting pregnant are coming... he says he can't perform.. though it doesn't seem he even tries... it's almost as if he's avoiding sex altogether around those days.. yet says he wants us to get pregnant (we do not have children yet)... 
He says the same thing when I am stressed out or a tad grumpy... which is related to lack of sex because my drive is constantly high... it's like he can't keep up with me anymore?? We are only in our late 20s and have been together for almost 5 years now. We have been through a lot emotionally the last couple of years, but if nothing is mentioned about my cycle or my emotions we have sex 1-3 times a week... otherwise he avoids any sort of "interaction" altogether.. unless it's in his sleep..?
Any suggestions, ideas, thoughts... I just feel like I'm less attractive or too demanding or something. Help...??