Sole custody?

Sam

My daughters father hasn’t seen our daughter since January. (Technically February but that was literally one day for an entire hour so I say January). He up and left his wife and three kids for a girl with six of her own. He spoke with our daughter for 30 seconds in March on her birthday and lied to her telling her he sent her a birthday gift. For two weeks she was asking me where it was and I just had to tell her he lied. He hadn’t spoke or been with his family in a year and a half because we were able to co parent nicely while they were out of the picture. Fast forward to May. He’s back with his family. (Only because they got denied the appeal seeking for grandparent visitation rights). In June he called cps on myself and my fiancé making up some bullshit story about how when my fiancé comes home from work I lock myself in the bathroom and drink excessively and that my fiancé has guns in the house that the kids can get to. (They’re locked in a safe in our basement) Anyway. He ended up getting unsupervised visitation with his other three kids against his soon to be ex wife in June all because she didn’t have a lawyer and she got fucked. Screwing it all up for me whenever I go to court. His family hires him a lawyer to go against me. They file for unsupervised visitation against me for my daughter (he’s had supervised visitation since January 2015). It got denied. So they filed again a second time. It got denied again. (Mind you. Since he now gets to see his other kids unsupervised. His family who hasn’t seen these kids in a year a half have now started paying his bills just to see the kids) I change lawyers to something more aggressive. My lawyer calls his lawyer to find out what’s going on and apparently the motion is just sitting at the courts. (Which is a lie. He had a falling out with a family like always and they stopped paying his lawyer in return he stopped letting them see the kids) so he’s running around telling people he’s tried calling me to speak with my daughter when I have my phone records printed out showing he hasn’t. My fiancé busts his ass to support and provide for my daughter plus the two kids we share together. And his dumbass doesn’t even make an effort to see/or speak with our daughter which I’m not going out of my way to do it. My daughter doesn’t and hasn’t even asked to see her father. This is the second time in five years he’s walked out on her. So my question is. It’s going on one year since he has seen her. I’m thinking about shooting for sole custody after that one year mark is up. Would I be in the wrong for doing so? I do anything and everything for her as well as my fiancé(he’s known my daughter since birth) so I just feel it’s right that I have sole. I would still allow supervised visitation but I’m not going to let someone walk in and out of her life as he pleases. Sorry for it being so long. And thanks to whoever reads the whole thing!