Can I give my 8day old baby cool boiled water?

I bottle feed my little boy but he's mouth always sounds so dry can I give him cool boiled water inbetween his feeds?