Relationship

I know this may sound weird but for a while now my fiancé has not been able to perform when he is drunk, and everytime he promises me we will have sex in a very romantic way and gets my hope up basically  and he also knows we are ttc. I am starting to get very hurt and tired of crying when he does do it because he will also be mean and then just go to sleep when I cry which makes me think he doesn't care. Idk what to do or if I am in the wrong for being mad even tho my hopes get crushed every time and he knows I don't get it ... Help