One reason for the safety of the city is that many areas are crowded with people, even late at night. Bad guys really can't get away with anything without having dozens of witnesses. I wouldn;t walk alone down any dark alleys at 4 am - but walking around a tourist area at any reasonable hour should be fine.