Fathers allowed to see children no matter what?

I strongly disagree with all fathers allowing to see their children, many are drug users/dealers, been charge off sex charges, fighting and more but still get to see their children. I've been known to this issue due to me fighting in court my babies dad is a drug users /dealer and has been charged for historical sex abuse charges! What's your view ladies?