The GitHub Actions job "Tests" on airflow.git has failed.
Run started by GitHub user ashb (triggered by ashb).

Head commit for run:
1df5b149674142eae430c8de006595d53282361a / Ash Berlin-Taylor <[email protected]>
Don't fail DagRun when leaf mapped_task is SKIPPED

This one was a fun one to track down, and was only a problem when the
scheduler "expanded" the first mapped task (making it SKIPPED).

- The scheduler looks at `add_one` and marks it as SKIPPED.
- `unfinished_tis` contains add_one_1, and `_are_premature_tis` changes
  the state of `add_one__1`, (which just so happens to be a leaf task),
  and the check on line 584 essentially gets confused, as no one
  envisaged the states changing!

In a reverse of how this normally plays out, if the mini_scheduler in
the LocalTaskJob was disabled then this example DAG would deadlock every
time. (Since that mini scheduler only operates on a partial DAG it can't
ever change the whole DagRun state.)

Co-authored-by: Ephraim Anierobi <[email protected]>

Report URL: https://github.com/apache/airflow/actions/runs/2936380039

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to