Are you giving your babies water with each meal?

If so, how much water are you giving? Not sure exactly how much water is safe so I've been giving 2oz total for the day. About 1/2-1oz of water per meal. Wondering if I should give more?