Disrespectful?

Little back story.. i went to my family house this past weekend. On my way out its a long drive i call my husband just to touch base. He tells me he was talking to him mom when i called. Im not controlling but she always talks to him about serious things when i leave.. to me it feels like they are going behind my back. Even though my husband tells me what they talked about.. but only the stuff my husband agrees with. I got back late sunday she helped with the kids for 2 hours. its a blended family situation. When i got home i said goodnight to the kids then i walked down stairs. She was waiting for me in the kitchen.. the kids came back smelling like cigs. But his mom and his ex says it was this type of cleaner.. words were exchanged. I told her im getting mad. (In my house) She just kept going. She started a fight with my husband and i about my ex. So i was already mad about that then all of this. And i walked away. To swaped laundry. I thanked her for watching the kids and she left. My husband thinks me walking away is disrespectful? My point of view i told her i was getting mad. And its my house. My husband said i should have communicated better. And i should say sorry. Also my husband asked where i learned walking away is okay. I said my family and he goes how is that working out for your family. That pissed me off. So hung up the phone. Then he proceeded to not pick up the phone or text me for 2 hours to prove a point that if i keep walking away. I wont have anyone... Him doing that i just think wtaf. I struggled with that because of past trauma plus its so childish. Then tuesday night i found out hes been looking at other girls on facebook.. my ex did very simular stuff so again past trauma.. if youre still reading this thanks. Would love your thoughts.