What would you do?

So my brother badly betrayed my husband and I, especially my husband as it affected him a lot. So since then my husband has said that our kids can’t go to my mum’s house anymore because my brother lives there too and he does not want my brother around our kids. My husband said that if my mum wants to see the kids then we can go somewhere like to restaurants or she can come over at anytime she wants. He is still hurting and I understand that but sadly my mum does not see how things like what my brother did isn’t good… after all any mother will take her son’s side. Now the thing is, my mum keeps asking me to bring our kids to her house for the weekend like I previously often did. I don’t know how to tell her that I can’t because I choose to respect my husband’s wishes. My mum overreacts and will turn around to make me the problem. If you were in my shoes, how would you handle this?