Re: Airflow looses track of Dag Tasks

___ > From: Maxime Beauchemin <maximebeauche...@gmail.com> > Sent: Wednesday, March 7, 2018 1:20:05 AM > To: dev@airflow.incubator.apache.org > Subject: Re: Airflow looses track of Dag Tasks > > Notice: This message originated outside of SRC. > > A

Re: Airflow looses track of Dag Tasks

Fokko <fo...@driesprong.frl> Sent: Wednesday, March 7, 2018 9:39 AM To: dev@airflow.incubator.apache.org Subject: Re: Airflow looses track of Dag Tasks Notice: This message originated outside of SRC. Hi John, There are some issues with Celery 4.1: https://github.com/ apache/incubator-airfl

Re: Airflow looses track of Dag Tasks

> > > > > - John K > > > From: Maxime Beauchemin <maximebeauche...@gmail.com> > Sent: Monday, March 5, 2018 11:57:16 AM > To: dev@airflow.incubator.apache.org > Subject: Re: Airflow looses track of Dag Tasks > > Notice: T

Re: Airflow looses track of Dag Tasks

: Maxime Beauchemin <maximebeauche...@gmail.com> Sent: Monday, March 5, 2018 11:57:16 AM To: dev@airflow.incubator.apache.org Subject: Re: Airflow looses track of Dag Tasks Notice: This message originated outside of SRC. Are you using the Kubernetes executor or running Airflow worker(s)

Re: Airflow looses track of Dag Tasks

Are you using the Kubernetes executor or running Airflow worker(s) inside persistent pod? How often does that happen? Does it randomly occur on any task, any pattern there? Max On Fri, Mar 2, 2018 at 7:09 AM, Kamenik, John wrote: > I have an airflow 1.9 cluster setup on

Airflow looses track of Dag Tasks

I have an airflow 1.9 cluster setup on kubernetes and I have an issue where a random DAG Task shows as fail because it appears that Airflow has lost track of it. The cluster consists of a database, redis store, scheduler, and 14 workers. What happens is the task starts as normal, runs, and