Parts of Gion (away from Gion corner) is extremely seedy at night and it can be quite uncomfortable walking through it. There are spruikers for the host clubs, and hookers about. That said, their attention seems to be toward Japanese men, not westerners. I wouldnt think it was unsafe, just unpleasant.