The GitHub Actions job "Check newsfragment PR number" on 
airflow.git/fix-new-asset-dag-historical-events has failed.
Run started by GitHub user shahar1 (triggered by shahar1).

Head commit for run:
3e0da08230569bc12fdad4f642eda38f4a8f44d8 / Shahar Epstein 
<[email protected]>
Stop new asset-triggered Dags from consuming historical asset events

When an asset-triggered Dag is added to a deployment whose assets already
have event history, its first run swept in every asset event ever recorded
because the event window fell back to date.min when no previous run existed.
A brand-new consumer therefore reprocessed the entire backlog on first run.

Bound the first run's window at the time the Dag started scheduling on its
assets (the schedule reference's created_at, which is preserved across
re-parsing) so a new Dag only receives events that occurred after it began
consuming the asset.

Closes: #39456

Report URL: https://github.com/apache/airflow/actions/runs/27824360742

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to