Autumn is one of the best times to visit Byron Bay because the warm temperatures of summer seem to stick around well into April, staying at an average high of around 20°C. Pair this with warm ocean temperatures and you've got yourself the perfect beach holiday - minus the large crowds that summer brings.