The vast majority of the Caribbean does not have a problem with clean drinking water, but on most islands you wouldn't want to drink it anyway because it's produced from desalinization plants and doesn't taste very good. So most people just drink bottled water, which I recommend.