is my marriage failing?

He's always working and never paying attention to our son. He says that he does but i see thats only for a max of 20 mins and thats it! I asked for his help yesterday because baby pooped big and i didnt want the poop to touch his head, when he came around, he didn't want to get close but was yelling at me because i had the baby with one hand and the other with the bucket of water. Kept yelling and cussing and i yelled back to stop, he punched the door (broke it) and i told him to get the hell out.. its not the first time we have this kind of fights..