The GitHub Actions job "Tests (AMD)" on airflow.git/airflow-65923 has failed.
Run started by GitHub user FrankYang0529 (triggered by FrankYang0529).

Head commit for run:
640f1190d5da3b32b3dee893125af170501210fc / PoAn Yang <[email protected]>
Add rerun policy for rollups when an upstream partition is re-run

When an upstream partition that a rollup's downstream window already
consumed is cleared and re-run, the framework had no defined behavior.
The de-facto outcome silently depended on the rollup's wait policy:
WaitForAll left a provisional run stuck waiting for keys that never
re-arrive, while MinimumCount re-fired the downstream run on partial
data. Neither is something a Dag author can rely on.

Give RollupMapper an explicit rerun_policy so the author chooses what
happens. The default preserves the historical behavior, so existing
Dags are unchanged; re-firing with the corrected data is opt-in.

Signed-off-by: PoAn Yang <[email protected]>

Report URL: https://github.com/apache/airflow/actions/runs/27853533854

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to