This depends on what you want to see. If you want to see it relatively empty and feel like you have Times Square to yourself, go in the early morning or late at night. Most things will be closed, but you can see what it looks like without as many crowds of tourists and office workers.