English is in common use in Japan with Chinese and Korean also becoming more common meaning that you can certainly get around without using Japanese. This is most true in the big cities and in areas frequented by foreign visitors. But as you move outside of the cities, foreign languages will quickly dry-up.