Actual opinions please.

If you have a baby and your mother has already gotten into an altercation with you (including yelling and slamming doors and pushing you) in front of the baby, would you let her be around him/her? This has happened to me once, and when it had happened I told her she wouldn't be around him if she acts like this - I also told her that she's very toxic. She then accused me of lying about her pushing me (I didn't) I think she was scared to get called the cops on, everyone believed her. She also then went on and said that I have to never say that she can't be around my child again (after the fight stopped) and how her house isn't toxic and how she isn't crazy which I think she is because yelling infront of an infant and actually throwing stuff and slamming doors is kind of crazy behavior. 
If I move out (which I am) what should I do communication wise? She already freaks out about my brother who moved out, not talking to her.