How to boil water for baby? And what water to use?

I have been using filtered water from refrigerator for my 5 month old baby. Sometimes I notice that the boiled water has some dish like stuff on top layered all over it. How should I boil water to avoid that buildup stuff

Yes I do give her water and use the boiled water to mix formula as well and her Pediatrician recommends a few sips of water throughout the day as she gets comstipation