Seprated two year seeking divorce but...

I've been wanting to get divorce for two years now but scared . I have two little girls by this man. He had visits but for the past year has not come to see them nor has he called them . he has NEVER paid child support and nor do I care about trying to make him. Let me explain. This marriage is ending do to him choosing alcohol over his family and being physically abusive toward me. He has been MIA for almost a year and really glad but as I said he was granted visits that he hasn't showed for what I'm worried about is that with divorce they will enforce the visits and my kids will go through that emotional trauma all over again. They have forgotten him over the year he went MIA and my fiancee to them is there daddy. Is there any way I can do this without finding him?