Dan Davydov created AIRFLOW-6253:
------------------------------------

             Summary: Task callbacks should not happen in main scheduler thread
                 Key: AIRFLOW-6253
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6253
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: 1.10.6
            Reporter: Dan Davydov


Currently dagrun callbacks (on_failure/on_success) happen in the main scheduler 
loop, which can affect or even stop scheduler performance e.g. if these 
callbacks hang.

 

These callbacks should happen in another thread with some timeout (logs for the 
callbacks should still be easily viewable)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to