Casa Loma is worth visiting at any time during the year, although visitors tend to have different opinions about which season offers the best experience. Many think that Casa Loma's charms are most apparent in the spring and fall, when temperatures are mild and the Gardens are in full bloom.