Not happy so won’t have sex.

So I’ve had a baby recently... the baby is now 3 months. I wake up at 6 every morning and I go non stop taking care of the house and baby and by the time my boyfriend arrives home I’m tired and I fall asleep an hour after dinner which is around 8pm. My boyfriend doesn’t sleep with me he sleeps in the living room. But when he does sleep with me I’ll surprise him in the middle of the night with sex. So I’ve fucked him twice since I’ve had our baby. But he’s always done within 5 mins and leaves the room. I get no reciprocation, no surprised sex no rubbing my feet, I don’t even get to cum when we have sex. So anyways this morning when he’s leaving for work he starts off by telling me that I’m never happy when I get home and that’s why he doesn’t fuck me. If I was happier he’d consider fucking me. I told him he needs to take care of me if he wants me to be happy. Not just going to work and support us. Believe me I love that. I say little prayers for him every-time he leaves just sending out good vibes for him. I help him stay healthy happy and loved. I don’t even feel like his girlfriend anymore I just feel like I’m just someone he has to take care of. I felt so bad about myself I started crying. We talked it out before he left. But now I’m sitting here wondering why I’m with a man who tells me I’m not good enough for him. I’m sick to my stomach. Please can someone suggest what I should do in a situation like this?