Should I be annoyed?

My husband hosted a party at his uncles house. There were couples and kids and I went with our 4 month old. I was tired but my husband Invited two important work colleagues and he wanted us to be there. He also invited lots of our couple friends and their kids so it was very casual. We went in separate cars because my husband needed to order food and get stuff ready. Honestly, I was slightly annoyed because he told me this last minute and I had to juggle getting the 4 month old ready and in the car and I had to get ready...not an easy task. The reason I didn’t want to go in the first place was because I’m so freaking tired being a mom to an infant and I knew I wouldn’t be able to really relax, drink and have fun...but I made the commitment so I went. I asked my husband to help but I still changed diapers, fed the baby, etc. I stayed for 2 1/2 hours until my little one cried like crazy because he was tired. He has a hard time sleeping outside the home. I told my husband I had to go and my husband stayed at the party! What the hell. It was 930pm and He said he didn’t even get a chance to break bread with his two colleagues and one of the colleagues girlfriend. Would you be ok letting husband stay while you leave with baby? Should I be more understanding?

I should clarify because based on a few comments people assume he needs to clean and be there until the end. It’s really his uncle who is hosting but my husband invited all the people and brought the food and provided the lighting. One of the colleagues and the girlfriend is actually staying the night there. He used this opportunity to break bread with colleagues and hang out with friends. Maybe I didn’t clarify enough. He really could leave at anytime and when I was leaving all the guests were getting ready to go except for the two colleagues and obviously the uncle and wife because they are staying there the night too