Despite its proximity to New England, Fishers Island is a hamlet of Southold, N.Y., a town on the eastern end of Long Island. Measuring about 7 miles long and a mile wide, Fishers has a year-round population of approximately 250, a number that swells to roughly 2,500 during the summer.