The GitHub Actions job "Tests (AMD)" on 
airflow.git/partial-subset-linear-membership-scan has succeeded.
Run started by GitHub user ColtenOuO (triggered by ColtenOuO).

Head commit for run:
890028b958936846e0a7dddcf350df64e7064b4c / ColtenOuO <[email protected]>
Speed up clearing downstream tasks on large Dags

partial_subset decided whether each downstream relative was already among the
matched tasks by scanning a list, once per relative. Both the list and the
relative count grow with the Dag, so the check cost O(matched x relatives) --
cubic in the task count for a Dag whose tasks mostly reach one another, which is
exactly what clearing with downstream on a deep Dag looks like.

Task ids are unique within a Dag, and the relatives are the same objects the
matched list already holds, so the identity scan answers the same question as a
constant-time lookup against a set of those ids.

Report URL: https://github.com/apache/airflow/actions/runs/31043126423

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to