The GitHub Actions job "Tests (AMD)" on airflow.git/perf/dag-processing-queue has failed. Run started by GitHub user shahar1 (triggered by shahar1).
Head commit for run: 98d0b221e9b8a76dc81d5b34dbe84abb63fc31c0 / Shahar Epstein <[email protected]> DAG processor: reduce file-queue de-dup from O(N²) to O(N) with OrderedDict Replace collections.deque with OrderedDict[DagFileInfo, None] for _file_queue. Membership testing and remove operations are O(1) instead of O(N), eliminating the quadratic cost in frontprio and re-add paths. Verified behavior-identical over 300 random ops against the old deque semantics. All 116 manager tests pass. Benchmark results (best-of-N, ms): files before after speedup 4000 2320.7 3.82 ~610× (frontprio re-add) 4000 2299.7 2.94 ~780× (front re-add) Also adds benchmark scripts to measure queue, file scan, serialization, and DB persistence bottlenecks. Co-Authored-By: Claude Haiku 4.5 <[email protected]> Report URL: https://github.com/apache/airflow/actions/runs/26660417537 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
