Brothers getting out of jail

Lu

My eldest brother has always been an interesting character. We've never gotten along. We are oil and water. He has mental issues, anger issues, very bipolar, lying consistently, just all around not there. Anyway, hes in jail because he and his wife had gotten into a fight with his ex wife in front of their kids. Hes been in jail for like a year and gets out monday. He'll be living with my mother. My mom likes to watch my 4 year old daughter quite often and when I found out the news, my brother was getting out, I told my mom that my daughter will no longer be spending the night there. The only way I trust my daughter being there, is if I'm there. My mom got upset and hasn't spoken to me since.

Am I in the wrong?

Btw, he has made a weird threat about my daughter when I was pregnant with her