Safety isn't really much of an issue around the monuments at anytime and the later you go, the more likely you'll be to have fewer people around. We've enjoyed many an evening at the monuments after 11pm, many times as the only ones there (which is more likely in the winter than in other times of the year).