Michael Spector created AIRFLOW-572:

             Summary: Remote (S3) log gets overridden when a task is executed 
                 Key: AIRFLOW-572
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-572
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Michael Spector

The log filename is given a suffix of execution_date, which can be the same for 
all invocations of the same DAG run, for instance: "2016-10-15T00:00:00". 

Options I see:

* There's an option called 'append' in S3 logging mechanism, but there's no way 
to use it. This option could be added to the configuration file.
* start_date could be used as a suffix instead of execution_date, this way 
every task invocation would have its own log file.

This message was sent by Atlassian JIRA

Reply via email to