Am i being fair

So my husband and i been going to counseling and trying to fix our marriage. His mom is our biggest problem she does and says what she wants and can get away with being disrespectful to me. Even tried to fight me while i held our youngest baby. I don't want the kids around her nor myself. But my husband has this dream of us getting along and being a happy family. Honestly ..i'm tired of trying with his mother. We just left and all i can do is cry and shutdown. I want to call it quits. It's been 5 years and no change how much can a woman take. Help give me your opinion.