Often times, if the aircraft you are on is late arriving from the previous flight, yours will be delayed because there is no plane to fly on. You can, but the airline can always move the time back up and as long as it isn't earlier than the original time, you're late.