Custody

So my daughters dad just told me he’s taking me to court for joint custody he wants summers and holidays , our daughter will be 2 in may , he lives out of state barely tries to be involved he’s visited maybe 3 or 4 times , next month will make a year that he’s came to visit , I’ve always had to travel to him in order for her to see him. He’s made excuses like he have to work or he doesn’t have the money for a plane ticket or a hotel. He pays $200 a month in child support , he’s been begging me to take him off i honestly didn’t want to cause i was afraid that if i did he wouldn’t help at all , so now to hurt me he’s taking me to court. I’m not comfortable with my daughter who’s still in diapers to be away from for a long period of time. She barely knows him I’ve never kept her away from him he’s just made every excuse to not be more involved, does anyone have any advice?