Can this backfire on me?

My baby dad does nothing for our children. He’s been in and out their whole lives. He’s never helped support them, never asks about them, never asks to see them. The only time he texts me is to either flip out about something dumb or to throw on this big sob story on how he misses ME and loves ME but never ever brings up the kids. I’m completely done with him, and tired of him blowing my phone up at times over dumb shit. If i blocked his number, could that backfire on me? Like if he were to one day go to court which i HIGHLY doubt that would ever happen, he has a daughter he hasn’t seen in over a year and said he doesn’t even care anymore. He just told me the other day he guesses he’ll never see our kids again and he’ll just start a new life up where he’s been living (2 hours from us). He does have other ways to contact me if he NEEDED too. He could message me on Facebook or through his brother, which i still have a good relationship with. Just wanted to make sure before doing so.