dacort opened a new issue, #31099: URL: https://github.com/apache/airflow/issues/31099
### Apache Airflow version 2.6.0 ### What happened When marking an EMR Serverless job as failed, the job continues to run. ### What you think should happen instead The job should be cancelled. Looking at the [EMR Serverless Operator](https://github.com/apache/airflow/blob/a6be96d92828a86e982b53646a9e2eeca00a5463/airflow/providers/amazon/aws/operators/emr.py#L939), I don't see an `on_kill` method, so assuming we just need to add that. I'm not sure how to handle the `EmrServerlessCreateApplicationOperator` operator, though - if the workflow has a corresponding `EmrServerlessDeleteApplicationOperator`, we'd probably want to delete the application if the job is cancelled. ### How to reproduce - Start an EMR Serverless DAG - Mark the job as failed in the Airflow UI - See that the EMR Serverless job continues to run ### Operating System n/a ### Versions of Apache Airflow Providers `apache-airflow-providers-amazon==8.0.0` ### Deployment Amazon (AWS) MWAA ### Deployment details _No response_ ### Anything else _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
