[
https://issues.apache.org/jira/browse/AIRFLOW-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matsubara Yuya updated AIRFLOW-6806:
------------------------------------
Description:
The task completes successfully, and the result is able to check on the UI.
However, there are cases where the Pod is keep running and will not end
forever. A zombie pod is born.
Use Operator like this,
default_pod = BashOperator(
task_id="test",
env=KubePodEnv,
retries=1,
xcom_push=True,
bash_command="python3 /opt/test.py ",
executor_config={
"KubernetesExecutor":
{ "volumes": volumes,
"volume_mounts": volume_mounts,
"affinity":affinity, }
},
dag=dag
)
was:
The task completes successfully, and the result is able to check on the UI.
However, there are cases where the Pod is keep running and will not end
forever. A zombie pod is born.
Use Operator like this,
default_pod = BashOperator(
task_id="test",
env=KubePodEnv,
retries=1,
xcom_push=True,
bash_command="python3 /opt/test.py ",
executor_config={
"KubernetesExecutor": {
"volumes": volumes,
"volume_mounts": volume_mounts,
"affinity":affinity,
}
},
dag=dag
)
> Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed
> ( keep running ) .
> ------------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-6806
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6806
> Project: Apache Airflow
> Issue Type: Bug
> Components: executor-kubernetes, executors
> Affects Versions: 1.10.9
> Reporter: Matsubara Yuya
> Assignee: Daniel Imberman
> Priority: Critical
>
> The task completes successfully, and the result is able to check on the UI.
> However, there are cases where the Pod is keep running and will not end
> forever. A zombie pod is born.
>
> Use Operator like this,
> default_pod = BashOperator(
> task_id="test",
> env=KubePodEnv,
> retries=1,
> xcom_push=True,
> bash_command="python3 /opt/test.py ",
> executor_config={
> "KubernetesExecutor":
> { "volumes": volumes,
> "volume_mounts": volume_mounts,
>
> "affinity":affinity, }
> },
> dag=dag
> )
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
