Custody Issues

I live in a 50/50 state and he’s threatening to keep my children away from me until I get him a storage unit so he can live in. For context he’s been living in my apartment for 2 1/2 years after he lost his job and apartment and he hasn’t had a job since. I ended up moving with my mother to get away from the mental, physical, & verbal abuse. We got on a week to week schedule but he would always try to push back he days so he could have more time to himself. I’m honestly sick of it and I wanna take him to court for full custody once I am able to get my children back. He literally is jobless & has nowhere to go after we finish moving the stuff out but wants me to be ok with him taking my children 🙄 the police said they cannot do anything since he is their dad but it doesn’t make sense. I’m the one who provides for my children ONLY me and he likes to downplay that because I get our second baby’s milk from WIC and says I only spend $80 on diapers and wipes but that’s something. On top of the clothes & every basic necessity that comes with having children. What proof do I need for court? I don’t even mind still doing week to week with him once I obtain custody but he’s too spiteful for me not to have that security and my heart is just breaking thinking about not being able to see my children. He’s calling me selfish because I won’t provide for him any longer and idk im ranting atp but im TIRED!! I need advice from somebody who’s been through this please