Pacifier question ( should I give it back)

My daughter will be two in September n recently took her paci away but now she sucks her middle n pointer finger. Did I take it away too soon... I took it bc everyone keeps telling me her teeth will be bad. I need some legit mommy advice.. should I give it back