The Romans started York around 71 AD. They built walls around their fort and then around the city that grew up on the other side of the River Ouse. Big bits of the walls of the Roman fort can still be seen and up to half of the rest are in the ramparts under the present walls.