The minimum amount of time you should leave to visit both the Statue of Liberty and Ellis Island is 2.5-3 hours. It may seem like a long time to carve out of your NYC vacation, but the process of getting over there is pretty tricky, and there is really a lot you should see.