The tap water in Nassau hotels is perfectly safe to drink, however it may have a bit of a strange taste which is why the majority of people drink bottled water. It is rarely noticeable when used for washing fruits or vegetables or when brushing teeth.