The tap water is safe to drink everywhere in Switzerland, including fountains. If not, there will be a sign saying so. It tastes like, well, water. Many people I know prefer tap water to bottled water, it's healthier because it contains more elements and hence has a richer taste.