andallo opened a new issue, #41212: URL: https://github.com/apache/airflow/issues/41212
### Apache Airflow Provider(s) cncf-kubernetes ### Versions of Apache Airflow Providers apache-airflow-providers-cncf-kubernetes 8.3.1 ### Apache Airflow version 2.9.2 ### Operating System Debian GNU/Linux 12 (bookworm) ### Deployment Official Apache Airflow Helm Chart ### Deployment details _No response_ ### What happened If driver pod was deleted (manually), SparkKubernetesOperator task take '**success**' status, despite driver wasn't complete all the jobs of SparkApplication. ### What you think should happen instead If driver pod was deleted, but wasn't complete his work, SparkKubernetesOperator task should take '**failed**' status. ### How to reproduce Start SparkApplication using SparkKubernetesOperator task. Wait until driver pod will be created. Delete driver pod during it does some work. SparkApplication completes immediately (with status=COMPLETED) and task will become success, despite driver wasn't complete the work. ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
