Should a father be allowed to see their child no matter what?

I'm still feeling guilty about not telling my ex about me being pregnant with my unborn daughter. Is it wrong of me? He was very abusive and controlling and it got to the point where I had to put a restraining order on him...am I wrong for making that choice?