Baby Daddy complains about getting up at night

So currently my SO and baby daddy is working M-F and I am on maternity leave for another few weeks. At this point our arrangement is that I will get up with the baby every night during the week since he works and needs his sleep, but on the weekends we take turns getting up with baby so I can have a break. It's exhausting for me during the week because the baby is up every 2 or 3 hours still. So last night I got up with the baby at 1am and was back in bed about 230. At 5am, the baby was hungry again so I woke up my SO and told him it was his turn. His immediate reaction was to complain about how the baby is not sleeping through the night and how he was tired and didn't want to get up. I swear I almost punched him in the face!!! Like, I do this every night. I'm up every night with him! Don't you think I'm freakin tired. But the one time he has to get up he lays there and complains about it! I'm so frustrated with him.