The GitHub Actions job "Tests (ARM)" on airflow.git/v3-3-test has failed.
Run started by GitHub user pierrejeambrun (triggered by pierrejeambrun).

Head commit for run:
ff75d24f0320565942508527c4806b99812e535d / Jason(Zhe-You) Liu 
<[email protected]>
Fix grid/graph view topological sort for group-level and cross-group 
dependencies (#69933) (#70591)

* Fix grid/graph view topological sort for group-level and cross-group deps

TaskGroup._project_child_deps only looked at a group's own upstream_task_ids,
which stays empty for a direct group-to-group dependency (list or individual
`>>`) and for a task-level dependency that crosses into another group's entry
task. Both cases sorted the group as if it had no upstream at all.

Now also pulls in the group's upstream_group_ids and its root tasks' upstream
task ids before projecting sibling dependencies. Applied to both the
serialization-layer sort and the mirrored design-time sort in task-sdk.

closes: #65291

Related: apache/airflow#67964 (closed for inactivity, written against the
topological_sort implementation before PR #67288/#67688 rewrote it) and
apache/airflow#65639 (draft, same issue, also predates the rewrite).

* Address review feedback: cache get_task_group_dict, describe test intent not 
issue numbers

viiccwen pointed out that fetching the group map inside topological_sort() 
rebuilds
the whole DAG's group tree on every nested group's own call, turning a render 
with
G groups into an O(G^2) cost. get_task_group_dict() is now memoized per DAG 
instance
(kept behind a small private helper since methodtools.lru_cache has no type 
stubs and
would otherwise widen the public method's return type to Any for every caller).

Also reworded test comments/docstrings that cited issue numbers to describe 
what's
actually being verified instead.

* Hoist common logic into shared lib

* Remove caching on get_task_group_dict

* Remove stale get_task_group_dict cache tests

The cache these tests asserted was removed in the previous commit, so the
identity check and the _get_task_group_dict_cached.cache_info() assertions
no longer apply.

* Add call-level task group memo to reduce calc

* Tidy Typy

* Add test for task group memoing

---------

Co-authored-by: TP <[email protected]>
Co-authored-by: LIU ZHE YOU <[email protected]>
(cherry picked from commit d7aa92913bfed7b37081a3962fb6072053fc8d75)

# Conflicts:
#       airflow-core/src/airflow/api_fastapi/core_api/services/ui/task_group.py

Co-authored-by: Hemkumar Chheda <[email protected]>

Report URL: https://github.com/apache/airflow/actions/runs/30362771802

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to