TTC husband issues..

Okay since everyone didn't ready my poll correctly... YES my husband has agreed to TTC our 1st child, yes he knows that I am not using protection. He every new month says "let's put 100% in this time, I want us to start a family" then he turns around and is only interested in having sex right after my period ends. I've tried things and he says he's just not in the mood. It so irritating and I feel like giving up... Am I alone or does anyone else have this issue too?