Help?

My son was born last month premature but ever since my sons father had been crazy controlling he's been abusive in every way before but now it's even worse he's a alcoholic and denied our son all over social media since I've been pregnant and still has yet to post anything about him. Has not bought one thing for him. He keeps telling me I'm a shitty person from keeping his son from him and then i start to feel bad but is it right for him to see him? Should I be keeping my son from him? I feel it's better off if he was out of our lives but then I feel for my son