Our family has found a full day to be the perfect amount of time to spend in Sirmione if you want to visit the main attractions of the town. If you're okay with just visiting a couple of things in town (for example, wandering the medieval town center and climbing the castle's tower), you could plan a half-day visit.