github-actions[bot] opened a new pull request, #71065:
URL: https://github.com/apache/airflow/pull/71065

   * Release TI lock before asset listener callbacks
   
   Asset registration on the task-success path (ti_update_state) ran the
   listener hooks synchronously inside the transaction holding a row lock
   on the task_instance table. A slow listener, multiplied across a large
   fan-out of asset events, could hold that lock for minutes, causing
   statement timeouts.
   
   The listener hooks are now deferred until the end of the endpoint
   instead of executed inline during asset event creation. Registration
   writes to the database still happen under the caller's transaction, so
   durability is unchanged; this only moves the best-effort listener hooks
   off the lock.
   
   * Optimize asset alias assoc insert
   
   * Fix exhausted iterator reuse bug
   
   * Test asset reg callback cases
   (cherry picked from commit 79db99500064aa801bcfad1b6f91b8be867f822c)
   
   Co-authored-by: Tzu-ping Chung <[email protected]>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to