knockknock10 commented on issue #72128: URL: https://github.com/apache/airflow/issues/72128#issuecomment-6824730300
Hi @amoghrajesh bhaiya, are u still working on this #72128 ? if u don't mind I'd be interested in contributing to this, particularly the live-worker failure path. I went through the two failure modes in the issue. I think it would be useful to separate the first one from server-side recovery after a worker is killed. I'd like to investigate a terminal-failure cleanup hook that can be used by operators and integrated with `ResumableJobMixin`. The important distinction would be that cleanup should run when an attempt has permanently failed, but must not cancel an external job that a retry is expected to reconnect to. I could focus on the hook design, the mixin integration, and regression tests for terminal versus retryable failures. Since you have this issue assigned, would you be open to having me work on this as a separate contribution? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
