Am I being selfish? 🤔

Victoria • My heart is in love with two beautiful children. 😍💙❤️
Question ladies?! 
My boy friend and I have two kids together. Ones 3 at the end of August and the other one is one month old. He just got out of the hospital yesterday due to personal reasons. My boyfriend works Monday they Friday 6am 6pm. He helps out on the weekends so I don't go insane. I also breastfeed so he can't do much other than change a diaper. Am I being selfish when I get mad that he's out with his friends drinking and having a good time while I'm home with the kiddos a 4 hour sleep day? He promises he'll help out on the weekend but I feel like he just blew us off to get drunk. He's an amazing father! He supports them and pays for everything. I don't work, he lets me be at home with this kids. I feel really bad but I never get a break and I feel like I'm drowning. Am I being selfish?!?! Help me. Has anyone else went thru something like this?