hussein-awala commented on PR #31829: URL: https://github.com/apache/airflow/pull/31829#issuecomment-1622302997
> The basic meaning of this config is: task_acks_late=True: celery workers [acknowledge tasks LATE](https://docs.celeryq.dev/en/stable/glossary.html#term-late-acknowledgment), AFTER they finish running task_acks_late=False: celery workers [acknowledge tasks EARLY](https://docs.celeryq.dev/en/stable/glossary.html#term-early-acknowledgment), just BEFORE they start running acknowledged in celery = marking it as succeeded Currently when the celery worker goes down, we get an exception "task killed externally". But after implementing the proposed change, it is unclear whether the scheduler will mark the task as succeeded or retry it. Further investigation or testing is required to determine the exact behavior in this scenario. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
