If you speak English and don't mind living in Japan's English-speaking, gaijin-friendly bubble, having little or no Japanese can be manageable most of the time. You'll still be able to meet new people, experience unique moments, and navigate much of Japan just fine.