The GitHub Actions job "Tests" on airflow.git/backport-22af27e-v3-1-test has 
succeeded.
Run started by GitHub user ephraimbuddy (triggered by ephraimbuddy).

Head commit for run:
589df29a348a194b6ff28a5553ac202cf00a0a1c / Ephraim Anierobi 
<[email protected]>
Fix backfill max_active_runs race condition with concurrent schedulers (#58807)

* Fix backfill max_active_runs race condition with concurrent schedulers

When two schedulers run concurrently, both could start more backfill
dag runs than max_active_runs allows. This happened because each
scheduler read the count of running dag runs before either committed,
causing both to see stale counts and start runs simultaneously.

The fix adds row-level locking on the Backfill table. When a scheduler
processes backfill dag runs, it first locks the relevant Backfill rows.
If another scheduler already holds the lock, the current scheduler skips
those backfills rather than potentially violating the max_active_runs
constraint.

This ensures that only one scheduler can process a given backfill's
dag runs at a time, preventing the race condition while remaining
non-blocking (schedulers don't wait on each other).

(cherry picked from commit 22af27ea5a750ed92b203bd47846e5197cfda7fa)

Report URL: https://github.com/apache/airflow/actions/runs/19856799543

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to