Baby’s father and income tax

So I claim my 21 month old daughter ok my income tax. Her father and I are co parenting. When I got my refund he basically told me how much money I was going to give him. I don’t mind giving him something but for him to demand a certain amount and make threats on me telling me he’s gonna call the IRS and get me audited it ridiculous.