Leave or Stay and try to work it out

Im currently 36 weeks pregnant with twins plus two boys at the house ages 8&4 my children father leaves 3 days a week from 7pm-6am to play poker around the corner at friends house but when he's not there all he do is sleep because of course he's tired to basically that leaves no time for me and our kids Am I'm over reaction when I basically about to end this relationship yes he is the only one working he pays all the bills and I get anything I ask for but personal time and affection I don't get and I'm not 16 so a pair of shoes is not keeping me happy