Dead beat father

So my ex( father of my child ) . For a month was consistent on seeing our child. But when he did come to visit He would literally have to sneak away from his house and then it would be a argument with his gf , bc he came to his child . She’s not allowed near my daughter bc his mother caught her buying drugs not just weed and caught her high plenty of times while in his mother’s house and I don’t feel safe with her near my daughter and my daughter also had severe allergies and he doesn’t feel safe having her by himself just incase anything happens bc he lives far So He and visits her at my house Or his moms . And he’s fine with it. But now he’s been more distant and won’t ever call . It’s be about a month since I spoke with him . The last thing we talked about was me meeting her which I didn’t want to but he said it will help with seeing our daughter because he doesn’t want to have to sneak around seeing her , I agreed bc I would do anything for my daughter to have her dad in her life. But I think it’s weird how she won’t let him see his own daughter Not even at his parents house . It kinda makes me feel like she’s jealous of my daughter and makes me worried when he will have her by herself