[
https://issues.apache.org/jira/browse/AIRFLOW-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maksym Shalak updated AIRFLOW-6782:
-----------------------------------
Description:
{color:#172b4d}I launch tasks using KubernetesPodOperator with
do_xcom_push=True{color}
{color:#172b4d}This creates my container with an airflow-xcom-sidecar container
inside a pod. {color}
{color:#172b4d}In 90% of cases that works fine, but sometimes my main container
completes, but airflow-xcom-sidecar is still running and never completes, which
prevents my pod from completion. {color}
{color:#172b4d}I see nothing in airflow-xcom-sidecar co{color}ntainer logs. The
data which I want to write is inside /airflow/xcom/return.json, so no bug there.
{color:#172b4d}Looks like this issue is common:
[https://stackoverflow.com/questions/54388441/kubernetes-pod-created-through-airflow-remains-in-running-state]
{color}
{color:#172b4d}Let me know if any additional information needed.{color}
was:
{color:#172b4d}I launch tasks using KubernetesPodOperator with
do_xcom_push=True{color}
{color:#172b4d}This creates my container with an airflow-xcom-sidecar container
inside a pod. {color}
{color:#172b4d}In 90% of cases that works fine, but sometimes my main container
completes, but airflow-xcom-sidecar is still running and never completes, which
prevents my pod from completion. {color}
{color:#172b4d}I see nothing in airflow-xcom-sidecar co{color}ntainer logs. The
data which I want to write is inside
{color:#6a8759}/ai{color}{color:#6a8759}rflow/xcom/return.json, so no bug
there.{color}
{color:#172b4d}Looks like this issue is common:
[https://stackoverflow.com/questions/54388441/kubernetes-pod-created-through-airflow-remains-in-running-state]
{color}
{color:#172b4d}Let me know if any additional information needed.{color}
> airflow-xcom-sidecar container prevents pods from completion
> ------------------------------------------------------------
>
> Key: AIRFLOW-6782
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6782
> Project: Apache Airflow
> Issue Type: Bug
> Components: xcom
> Affects Versions: 1.10.7
> Reporter: Maksym Shalak
> Priority: Major
> Attachments: Screenshot from 2020-02-12 16-19-49.png
>
>
> {color:#172b4d}I launch tasks using KubernetesPodOperator with
> do_xcom_push=True{color}
> {color:#172b4d}This creates my container with an airflow-xcom-sidecar
> container inside a pod. {color}
> {color:#172b4d}In 90% of cases that works fine, but sometimes my main
> container completes, but airflow-xcom-sidecar is still running and never
> completes, which prevents my pod from completion. {color}
> {color:#172b4d}I see nothing in airflow-xcom-sidecar co{color}ntainer logs.
> The data which I want to write is inside /airflow/xcom/return.json, so no bug
> there.
> {color:#172b4d}Looks like this issue is common:
> [https://stackoverflow.com/questions/54388441/kubernetes-pod-created-through-airflow-remains-in-running-state]
> {color}
> {color:#172b4d}Let me know if any additional information needed.{color}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
