How much time you will need will depend much on what time of the year you are there and what time of day you choose. It also depends on whether you have pedestal and crown tickets. The ferries to the Statue of Liberty and Ellis Island depart every 15-20 minutes.