This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new 7c2ed53 Docs: Clarify behavior of delete_worker_pods_on_failure
(#14958)
7c2ed53 is described below
commit 7c2ed5394e12aa02ff280431b8d35af80d37b1f0
Author: Jed Cunningham <[email protected]>
AuthorDate: Tue Mar 23 11:21:26 2021 -0600
Docs: Clarify behavior of delete_worker_pods_on_failure (#14958)
Clarify that the `delete_worker_pods_on_failure` flag only applies to
worker failures, not task failures as well.
---
airflow/config_templates/config.yml | 2 ++
airflow/config_templates/default_airflow.cfg | 2 ++
2 files changed, 4 insertions(+)
diff --git a/airflow/config_templates/config.yml
b/airflow/config_templates/config.yml
index 663049f..69f3671 100644
--- a/airflow/config_templates/config.yml
+++ b/airflow/config_templates/config.yml
@@ -2021,6 +2021,8 @@
description: |
If False (and delete_worker_pods is True),
failed worker pods will not be deleted so users can investigate them.
+ This only prevents removal of worker pods where the worker itself
failed,
+ not when the task it ran failed.
version_added: 1.10.11
type: string
example: ~
diff --git a/airflow/config_templates/default_airflow.cfg
b/airflow/config_templates/default_airflow.cfg
index 066fef1..d9b26fb 100644
--- a/airflow/config_templates/default_airflow.cfg
+++ b/airflow/config_templates/default_airflow.cfg
@@ -989,6 +989,8 @@ delete_worker_pods = True
# If False (and delete_worker_pods is True),
# failed worker pods will not be deleted so users can investigate them.
+# This only prevents removal of worker pods where the worker itself failed,
+# not when the task it ran failed.
delete_worker_pods_on_failure = False
# Number of Kubernetes Worker Pod creation calls per scheduler loop.
