Advice please

My ex-fiance and I have broken up after 7 years. He's a terrible, emotionally manipulative guy, bad father,etc. We have a 1 year old daughter and he wants to keep communication with her. I don't have a problem with that but every time he calls for her and i answer he curses at me, offends me, tells me a lot of things. It's really upsetting. What should I do?

I don't have to tolerate it so when it becomes too much I hang up the phone/video call. When I do, he starts telling people or calling my family to tell them how I'm forbidding him from having contact with his daughter. He says how he's such a good father, but forgets to say all he says.