1. Brussels, Belgium. Brussels takes the top spot as the hardest city to drive in, with an overall score of 23 out of 100. In Brussels, the average person spends 236 hours in rush hour a year, with the average speed during this time being 12.4 mph.