Re: Airflow DAG deadlock, "SKIPPED" state not cascading

Awesome.. thanks Bolke! On Wed, Jun 14, 2017 at 6:10 PM Bolke de Bruin wrote: > I have created PR https://github.com/apache/incubator-airflow/pull/2365 < > https://github.com/apache/incubator-airflow/pull/2365> for this issue. > > Bolke > > > On 14 Jun 2017, at 16:26, Bolke

Re: Airflow DAG deadlock, "SKIPPED" state not cascading

I have created PR https://github.com/apache/incubator-airflow/pull/2365 for this issue. Bolke > On 14 Jun 2017, at 16:26, Bolke de Bruin wrote: > > Sorry missed your comment on the dag. Will have a look. > >> On 14

Re: Airflow DAG deadlock, "SKIPPED" state not cascading

Sorry missed your comment on the dag. Will have a look. > On 14 Jun 2017, at 13:42, Daniel Huang wrote: > > I think this is the same issue I've been hitting with ShortCircuitOperator > and LatestOnlyOperator. I filed > https://issues.apache.org/jira/browse/AIRFLOW-1296 a few

Re: Airflow DAG deadlock, "SKIPPED" state not cascading

Do you have a dag definition that exhibits the issue? If I can reproduce it I'll do my best to get it into 1.8.2 Sent from my iPhone > On 14 Jun 2017, at 13:42, Daniel Huang wrote: > > I think this is the same issue I've been hitting with ShortCircuitOperator > and

Re: Airflow DAG deadlock, "SKIPPED" state not cascading

I think this is the same issue I've been hitting with ShortCircuitOperator and LatestOnlyOperator. I filed https://issues.apache.org/jira/browse/AIRFLOW-1296 a few days ago. It includes a DAG I can consistently reproduce this with on 1.8.1 and master. I get the "This should not happen" log message

Re: Airflow DAG deadlock, "SKIPPED" state not cascading

Please provide the full logs (you are cutting out too much info), dag definition (sanitized), airflow version. Bolke Sent from my iPhone > On 13 Jun 2017, at 23:51, Rajesh Chamarthi wrote: > > I currently have a dag which follows the following pattern > >

Airflow DAG deadlock, "SKIPPED" state not cascading

I currently have a dag which follows the following pattern short_circuit_operator -> s3_sensor -> downstream_task_1 -> Downstream_task_2 When short circuit evaluates to false, s3_sensor is skipped, other downstream task states remains at None and DAG Run fails. couple of questions : 1) Which