It's generally safe and healthy to drink the public tap water across Portugal. Get a water filter such as TAPP 2 to improve the taste and reduce the risk of contaminants. Avoid plastic bottled water in Portugal as most plastic doesn't get properly recycled. Get a high quality reusable water bottle like TAPP.