silly question-how to drink a lot of water on vacation?😬

I'm going away on march 30th. I normally drink a lot of bottled water at home. I'm sure I won't have access to a ton of water in St Thomas. Do you think it's okay to drink the tap water?