Co parenting advice?

So I don’t know what to do, my daughter is 5 and she’s getting ready to start school. School is important to me and I want her to be able to do good and not be stressed or anything like that when it comes to home life. She goes with her dad a lot during the week after he gets off of work, and I don’t mind but I’d appreciate it if maybe he brought her back in time to be able to give her enough time to get ready for bed and school the next day. So about 8-8:30pm latest, so she can have about an hour to get ready for bed and get sleep. During the weekends I try not to interfere too much with what he does with her but his mom is always reaching out to me the next day (if daughter spends the night with her dad) saying he’s passed out from a night of drinking, which he does with her in his custody and still thinks it’s safe to drive around with her, and wants to bring her home to me. Now I don’t mind that she comes home since he can’t seem to be responsible enough to wake up and care for her, it bugs me that his mom just lets him sleep and doesn’t try and enforce him to be a parent hangover or not though.

Now I’m so close to just keeping her with me all the time due to the issues during the week since she’s going to be starting school now, and the issues on the weekend. I’m pregnant right now (his, not relevant I know but) and I can’t be dealing with the stress of him not learning to be responsible for her let alone a baby. Am I being too harsh? Should I enforce some type of ground rules? I’ve never been one to keep her from him but he still tries and acts like he’s a teenager out partying throughout the nights with our daughter and not knowing how important I think school is and a good nights rest for her to do good in school. What can I do so I don’t just take her from him completely but also trying to keep her safe and him aware that education is important?