Signing over rights

So, the father of my children (3 & 2) wants to sign over his rights bc he doesn’t want to deal with me ever again. He doesn’t see them when we’re not together (used to be on & off) & says I’m a horrible mother, cusses me out, says I’m a liar, have no integrity, etc.

Would you let him sign over his rights? I feel it’s VERY selfish & he should help take care of HIS kids since he helped make them. I should not have to struggle by myself all bc he doesn’t want to deal with me. On the other hand, why put my kids through this BS?!