Vijay Arum created AIRFLOW-2996:
-----------------------------------
Summary: Airflow subdag is failed while the child task is still
running or succeded
Key: AIRFLOW-2996
URL: https://issues.apache.org/jira/browse/AIRFLOW-2996
Project: Apache Airflow
Issue Type: Bug
Components: subdag
Affects Versions: 1.9.0
Reporter: Vijay Arum
Airflow subdag is failed while the child task is still running or succeded.
subdag when retries on failure , tries to execute the child task which is
already in running , this causes a deadlock and subdag is failed eventually
after all attempts. while all child task succeds.
this issue occurring frequency is not that often .
i have a subdag with bunch of tasks. i have set retries to 2. once in a while
the subdag fails in {color:#14892c}first attempt bcoz of mysql
connection{color} "{color:#FF0000}sqlalchemy.exc.OperationalError:
(_mysql_exceptions.OperationalError) (2013, 'Lost connection to MySQL server at
\'reading initial communication packet\', system error: 0 "Internal error/check
(Not system error)"') (Background on this error at:
[http://sqlalche.me/e/e3q8)]"{color}
subdag initiates retry 1, subdag tries to re execute running child task, which
violates task instance state violation. {color:#d04437}"Task is in the
'running' state which is not a valid state for execution. The task must be
cleared in order to be run." {color:#333333}subdag retry evenually fails with
the message{color} "following taska are deadlocked "{color}
{color:#d04437}{color:#333333} subdag initiates retry 2,{color} subdag tries to
re execute running child task, which violates task instance state violation.
"Task is in the 'running' state which is not a valid state for execution. The
task must be cleared in order to be run." {color:#333333}subdag retry evenually
fails with the message{color} "following taska are deadlocked "{color}
{color:#333333}finally subdag is marked as failed while all child tasks
suceeds{color}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
