The GitHub Actions job "Tests (AMD)" on airflow.git/feat/asset-watcher-match has failed. Run started by GitHub user Lee-W (triggered by Lee-W).
Head commit for run: d1fb0125279c009be1377cbcf0d8eab992c042eb / Wei Lee <[email protected]> feat(triggerer): share one poll across sibling event triggers When several AssetWatcher instances back triggers that read from the same upstream resource (one SQS queue, one Kafka topic, etc.), the triggerer spins up N independent poll loops today — one per trigger. Issue #66476 asks for one shared poller serving all of them. Add an opt-in path on BaseEventTrigger, with no change to AssetWatcher, Asset, or the Dag-author API: - `shared_resource_key()` — return a non-None key to declare that this trigger's underlying I/O can be shared with siblings whose key compares equal. - `open_shared_stream()` — class-level coroutine the triggerer drives once per shared key to produce raw events. - `filter_shared_stream()` — instance-level transformer that turns the shared raw stream into this trigger's TriggerEvents (per-trigger filtering lives here). The triggerer routes participating triggers through a new SharedResourceManager that runs one poll task per distinct key and broadcasts events to per-subscriber queues. Triggers whose `shared_resource_key()` returns `None` (the default) keep their existing independent `run()` loop untouched, so nothing currently shipped changes behavior. Report URL: https://github.com/apache/airflow/actions/runs/25733528108 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
