I personally would not recommend drinking the tap water purely because most Mauritians I know drink bottled water, so I follow their example. Never had any problems with brushing my teeth with the tap water or ice cubes in drinks (presuming they are made from tap water).