ashb commented on issue #4083: [AIRFLOW-3211] Reattach to GCP Dataproc jobs upon Airflow restart URL: https://github.com/apache/incubator-airflow/pull/4083#issuecomment-432170898 This PR seems sensible - though I would have fixed this by changing your deploy process to not kill your workers - you don't need to do that to pick up the latest version of DAGs. (Airflow is very careful to not load DAG definitions in to any long running process, so each time a task form a dag runs it will pick up the latest definition from disk)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
