Trying to figure out what’s best?

Hi ladies I’m hoping maybe I can get a little advice on which way I should go . So here’s my story.

I have a 4 year old . Fathers only met him

Twice in his life he has nothing to do with us doesn’t send child support or help us in anyway . Now I’ve been told I should go after child support but I’ve also heard some people I know saying they wished they never would have done it because the “losers” caused so much drama and stuff . As of right now the only thing he has is my sons last name so I do have all the rights . I’m completely content and able to take care of my son myself . My ex refuses to talk to me as to even giving his rights away . How should I go about this or should I just move on with my life just me and my son ?