Offering water instead of milk at 7 months

Has anyone done this?? Going to try tonight because he just keeps waking and will have an Oz or 2 so maybe hes just thirsty?? Does this 2/3 times a night surely he's not hungry