Do newborns need water?

This may be a silly question but do you give babies water along with milk? If so tap water ok?