Have a leisurely lunch, then there is usually something to see, whether a church or museum, or just wander a neighborhood, or yes, go back to your hotel and siesta like the locals. Particularly in Spain where I hear the usual dinner hour is at 9pm or 10pm (a good hour later than even Italy).