Being punished for not having sex?

Last night my partner was wanting sex and had expressed this to me, I agreed as for once I wasn’t in pain (I suffer with chronic health issues). It got to the evening and we were sat on the sofa trying to get our 2 year old to sleep, and he fell asleep too. I tried to wake him up but he was out cold, snoring loudlyyyy. I ended up falling asleep on the sofa too. I woke up at midnight and woke him up, and now he’s punishing me because he didn’t get sex? He went to bed lastnight facing away from me without saying I love you. He said that I should’ve made more effort and woke him up regardless. I said it wasn’t my fault and that he can’t be punishing me for him falling asleep anf missing the moment. We’ve woken up this morning and he is still ignoring me. Hasn’t said a single word to me and now I feel awful! I know this is the back lash of him not getting what he wanted lastnight even though I’m not to blame…

This isn’t the first time it’s happened. If ever he wants sex but something gets in the way (I’m in pain, I feel sick, I’m tired, our daughter is awake) I face the wrath and get endless comments made about how it’s my fault and I need to make more effort.

It makes me feel like shit.