jason810496 commented on issue #59602: URL: https://github.com/apache/airflow/issues/59602#issuecomment-3763321650
Even when using CeleryExecutor with KubernetesPodOperator, it's still CeleryExecutor's responsibility to upload the logs. For each task (no matter what kind of operator you are using, even with KubernetesPodOperator), we create a TaskSDK subprocess via `supervise` call. Whether the logs are uploaded successfully or not depends on the TaskSDK subprocess. https://github.com/apache/airflow/blob/7524107bf5ca6254abf43e024c33c1fb5e1dd7c6/providers/celery/src/airflow/providers/celery/executors/celery_executor_utils.py#L162-L170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
