Don’t know what to do about my baby father

Okay so I need a little guidance, me and baby father got into a huge altercation. He asked me could he watch our daughter which I thought was weird because I haven’t heard from him in about a week or two since our last argument. So I agreed because of course I’m not going to keep her away from him. So I get there and it’s this woman there I’ve never seen before. I asked who she was and he said it was his gf. I said okay I don’t feel comfortable with her staying overnight with her too since I never met her before. So I asked him to call me when she’s gone then he calls and says she gone and she’s still there! So I said okay I’ll just wait until she leaves. THEN she gets mad and starts telling me how to raise my child mind you I watch her 24/7 he only watches her once a night every other week. She calls me bitches and all this blah blah(I fussed back too) so she said her brother is picking her up so I’m like okay she’s still going off at the mouth saying she’ll give me two black eyes and her pussy is better than mines and tits are saggy and I’m like wtf this has to do with anything?! Meanwhile he’s trying to take our daughter out the car while he’s letting this girl talk shit in my face. So I call my mom and she comes with my uncle and two sisters THEN it’s a war and she backs down and tell him to call the cops mind you he has weed plants growing in his house one of the reasons I moved out! They get there and raid his house because of the smell. He let his younger brother take the blame because he doesn’t want to lose his job. Now he’s saying it’s my fault but how and I left asking could she leave and you call telling me she’s gone? He only met her 2 weeks ago and we were together 2 years with a 1 year old. He’s 21 and I’m 22 and she’s 36. I really want to talk him and ask him one more time how should we do this with our daughter I always want her to have a dad because I didn’t but I feel kinda feel betrayed that he would let this woman talk to me like that in front of our daughter. How do I know if she’ll be around when I’m not ? She’s defiantly not someone I want around her now saying all these things and barely knows me. Idk what to do should I leave it alone and let him be or?