Even though you can't get to the Hamptons from NYC via ferry, you can pick up a ferry in New London, CT to Sag Harbor. If you are traveling from Boston, Connecticut and even Westchester, there's no need to come all the way into NYC just to drive out — you can take the New London ferry.