No, you can't drink unfiltered tap water in Mexico. The local water isn't safe for consumption so everyone, including locals, usually drinks bottled or filtered water. We've stayed at many Airbnbs throughout Mexico and it's always a plus when we find a water dispenser or water purifier.