The GitHub Actions job "Tests AMD" on 
airflow.git/localexec-starting-tasks-too-early has failed.
Run started by GitHub user ashb (triggered by ashb).

Head commit for run:
b5be8e5f01d186697d7a6dd3e1a7685c40e1cd03 / Ash Berlin-Taylor <[email protected]>
Fix issue where LocalExecutor could start tasks before the state was commited

With some recent changes LocalExec was now able to start a task _too quickly_,
and due to it's custom implementation of `queue_workload` it was directly
sending the message to the MP queue the task in queue_workload, which means if
there is an idle worker process already it will pick it up "instantly" --
crucially before the database transaction in with TI.state is changed from
scheduled to queued, is committed!

The fix here is to correctly follow the BaseExecutor interface, and not start
send the workloads for processing until heartbeat is called (which happens in
the scheduler right after the transaction is committed.)

Report URL: https://github.com/apache/airflow/actions/runs/17954784368

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to