There's no problem drinking the water in the Bahamas. It depends on where you are in the Bahamas, some of the outer island, or family islands have brackish water out of the tap and the hotels will provide bottled drinking water. If you are on Nassau or Freeport the water is fine and you won't have any problems.