ashb commented on issue #60858: URL: https://github.com/apache/airflow/issues/60858#issuecomment-6170883233
At the very least, I agree that no OL fail event depending on the path is a bug. Can we send it multiple times, or does OL expect/require that it is at-most once delivery of the event? And while I find needing to go to dag processor for task events very annoying, I think the same thing should happen for on_fail callbacks. However: If the task process is killed, what should the supervisor do? Try to spawn new process to run the failured callback there, or somehow signal to the supervisor "I didn't run the callback" and let it go via the dag processor callbacks. When you say "when the supervisor itself reports a signal kill", what did you have in mind? So if we can resolve how to ensure it is run an appropriate, and documented number of times (1? exactly-once delivery of a message is captial-H Hard problem) then yes, this is a bug to fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
