My daughter hates her father

So my almost 4 year old daughter. Her father and I separated shortly after she was born. I moved 1500 miles away to be near my family. During the 3 years I was gone, she saw him a couple times in person and FaceTimed him often. She never really was excited to talk to him, but she would do it. I didn’t blame her since she didn’t really know him because I left when she was a baby.

Fast forward to now. I am married and my husband and I just moved back to Texas, where she was born and where her father lives. She absolutely throws a tantrum about seeing him or even talking to him. She screams that she “hates him” and says she’s “not going to daddy’s house, no way.” She says he’s mean to her, but when I ask why she can never give me an answer. Even when we aren’t talking about him at all, she randomly says that she hates him. This happens all the time.

A little background - I left him because he was emotionally and physically abusive to my son, who isn’t his. My son was 5 at the time. He would belittle him all the time. The second he pushed him, I kicked him out and I was on a plane home within a week. I stupidly never called the cops. Honestly I just wanted to get as far away from him as possible immediately. He has a lot of issues - he’s basically a man child. Gambling addict. But he had started to turn it around and was being more responsible. He was so excited when we moved back. I know he genuinely loves her. Honestly he has no family here, no girlfriend, no other children. She’s all he has and I know he wants to be a good dad, sometimes I just think he lacks the patience and skills.

I don’t think he’d ever put his hands on his own kid, but I don’t know that for sure. I mean anything is possible. I don’t want to be naive because he did hurt my son. I’ve asked her countless times if he’s ever hurt her or yelled or spanked and she’s always said no. She spends only a couple hours a week with him because she won’t tolerate anything longer.

I guess I just thought in the beginning it was an adjustment she’d get used to, but it’s getting worse. If I mention him in any way she screams and gets extremely angry “I HATE MY DADDY I HATE HIM”

Has anyone else dealt with this? Should I consider counseling? I’m just at a loss. Her dad sucked as a partner and a step dad, but he is her father and I want to at least give him the opportunity to be good to her. Of course the second I suspect any type of abuse I’m calling the cops, but I honestly don’t think that’s what’s going on here. He’s very loving with her and desperately tries to win her affection, but it just isn’t happening. Maybe she just has a gut feeling about him?