Baby teeth decay

My 20 months two front teeth are turning Brown. And it seems like the teeth is falling. Has anyone gone through this? I brush my babies teeth everyday and I don't give him candy at all. Help please . Any advice? Remedies?