The GitHub Actions job "Tests" on airflow.git/main has failed.
Run started by GitHub user potiuk (triggered by potiuk).

Head commit for run:
22af27ea5a750ed92b203bd47846e5197cfda7fa / Ephraim Anierobi 
<[email protected]>
Fix backfill max_active_runs race condition with concurrent schedulers (#58807)

* Fix backfill max_active_runs race condition with concurrent schedulers

When two schedulers run concurrently, both could start more backfill
dag runs than max_active_runs allows. This happened because each
scheduler read the count of running dag runs before either committed,
causing both to see stale counts and start runs simultaneously.

The fix adds row-level locking on the Backfill table. When a scheduler
processes backfill dag runs, it first locks the relevant Backfill rows.
If another scheduler already holds the lock, the current scheduler skips
those backfills rather than potentially violating the max_active_runs
constraint.

This ensures that only one scheduler can process a given backfill's
dag runs at a time, preventing the race condition while remaining
non-blocking (schedulers don't wait on each other).

Report URL: https://github.com/apache/airflow/actions/runs/19860625108

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to