Diagon Alley / Victoria Street It's easy to see where J.K. Rowling got her inspiration for Diagon Alley. Victoria Street curves down towards the Grassmarket and is within Edinburgh's Old Town - recognised as a World Heritage site. The eclectic mix of narrow, medieval buildings and Gothic spires is pure Potter magic.