jaketf opened a new issue #10385:
URL: https://github.com/apache/airflow/issues/10385


   **Description**
   
   This operator should cancel running workflow template `on_kill`. This option 
probably should be configurable because of request_id prameter in a job 
definition: 
https://googleapis.dev/python/dataproc/latest/gapic/v1/api.html#google.cloud.dataproc_v1.WorkflowTemplateServiceClient.instantiate_inline_workflow_template
   
https://googleapis.dev/python/dataproc/latest/gapic/v1/api.html#google.cloud.dataproc_v1.WorkflowTemplateServiceClient.instantiate_workflow_template
   
   Note this will have to cancle the Google Long Running Operation for the 
workflow template (which will in turn cancel all children jobs and clean up 
relevant cluster).
   
   **Use case / motivation**
   
   Remove dangling workflow templates
   
   **Related Issues**
   #10381
   #6371


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to