johnhoran opened a new issue, #56895: URL: https://github.com/apache/airflow/issues/56895
### Description When using the kuberenets pod operator in deferred mode it sets timeouts to periodically check the status of the pod, and to return to the operator mode to tail any logs. This adds delays to the execution for very short running tasks, or load switching back and forth between the triggerer and operator. Especially when using KPO + kubernetes executor as you then need to wait for the executor to spin up a pod for the operator. Kubernetes supports event streams on pods via watches, as well as streaming the logs. Both things are supported by the kubernetes-asyncio library used by airflow. ### Use case/motivation _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
