Edgar Rodriguez created AIRFLOW-2084:
----------------------------------------

             Summary: CLI `airflow run` removes file pointed by argument 
cfg_path without any context
                 Key: AIRFLOW-2084
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2084
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Edgar Rodriguez


When running `airflow run` via the CLI and the `cfg_path` is passed 
([https://github.com/apache/incubator-airflow/blob/master/airflow/bin/cli.py#L379)]
 the file is removed. This is usually a bad pattern because the {{run}} command 
in the {{cli}} (a new process) is removing a file it does not maintain, making 
it harder for the caller (the parent process) to clean up the files that it 
actually creates / maintains. Furthermore, the process removing the file does 
not have any more context about the file, making this code brittle.

This design gets in the way of implementing proper handling from the parent 
processes providing the configuration files, which ideally should be using a 
context manager.

For more referece see: 
https://github.com/apache/incubator-airflow/pull/2991#discussion_r166745402



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to