It's true that Tokyo, Kyoto, and Osaka are all relatively international cities with a foreign population, but it's restricted to small areas. For instance, in Tokyo, you may find that it's easier to get by speaking English in small areas such as the Minato or the Shibuya ward, where most foreigners live.