The GitHub Actions job "Tests" on airflow.git has succeeded.
Run started by GitHub user hterik (triggered by hterik).

Head commit for run:
c9b95dca3dfcfd51fbd4176c86ff78e3a11f3c07 / hterik <[email protected]>
Don't re-patch pods that are already controlled by current worker

After the scheduler has launched many pods, it keeps trying to
re-adopt them by patching every pod. Each patch-operation
involves a remote API-call which can be be very slow.
In the meantime the scheduler can not do anything else.

By ignoring the pods that already have the expected label,
the list query-result will be shorter and the number of
patch-queries much less.

We had an unlucky moment in our environment, where each
patch-operation started taking 100ms each, with 200 pods in
flight it accumulates into 20 seconds of blocked scheduler.

Report URL: https://github.com/apache/airflow/actions/runs/3152348534

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to