when you fight?

When arguments start up and things get heated and things get said that probably shouldn't be do you take them to heart? I was practically told he was not to the point of cheating "yet" but how we can never get along anymore is pushing him that way. Then he blames me for starting it so he just says stuff. We hit a small financial hardship and has turned him into someone I no longer know. Life is all about him these days. I know im not perfect but never would I think of cheating. We have a almost 1 yr old and a baby due in December. I refuse to leave my home. Do you think I should take these words to heart? I try to talk to him about it and he just blames me and acts smart...