Need advice

I left my ex 6 years ago and we have a 10 year old daughter together. During the time i was gone i met someone and we had a baby girl 6 months ago. This man cheated on me for 6 months of my pregnancy and we tried to work through it but when our baby was born he ended up walking out on us and going to the girl he cheated on me with. I didnt know what to do and i ended up coming back to my ex. I have now been here for 6 months and its like i never left. He calls me every name in the book and its all in front of our daughter. Every day he tells me to get the fuck out but says i cant take our daughter with me. I do have sole custody of her so i know he cant make her stay. I have been keeping a log of everything that's been happening. I nanny out of my home as of now. He keeps wanting me to have sex with him and i wont because im not ready but he says thats just a bullshit story. I dont want to have sex with him and i cant have sex with someone who is constantly calling me a whore and whatever else he wants to say. I only came here because i didnt know what else to do and it was easy. What do i do? My daughter doesn't even even want to stay but i know she loves her dad very much