It's up to you how long you want to stay in each place. We visited the museum and spend little over an hour there but you can spend longer there. In total we spend about 8 hours for the round from Hakone Yumoto and back there including waiting time for the ship which we used to get lunch in the restaurant.