jedcunningham opened a new pull request #14085:
URL: https://github.com/apache/airflow/pull/14085


   closes: #11982 
   
   SchedulerJob doesn't actually call the executors `end` method when the 
scheduler receives SIGINT/SIGTERM or when there is an exception (e.g. database 
connectivity issues).
   
   If you are using KuberenetesExecutor, this results in the scheduler not 
actually exiting.
   
   In contrast, if you are using LocalExecutor, this results in the scheduler 
not dealing with the tasks it is currently running. By ensuring the executors 
`end` method is called, LocalExecutor will now wait around until the tasks 
complete or a second SIGINT/SIGTERM/exception. I believe we need to document 
that behavior change somewhere, I just haven't looked where yet.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to