vandonr-amz opened a new pull request, #30757: URL: https://github.com/apache/airflow/pull/30757
follow up on https://github.com/apache/airflow/pull/30720 It is not possible to stop an application that has running jobs. Applications can be stopped as part of the normal process, or in a degraded/timeout scenario, in which case we really want to stop the app no matter what. It's nice to have an option to do that from the operator directly. NOTE: If extra jobs are launched after the stop/delete operator is called, then it's not going to work properly, and will likely end on a timeout in the waiter, but to support that we'd need to go back and forth between get_jobs and cancel_jobs, possibly never converging. I'm assuming that this is good enough for most use cases. NOTE 2: I didn't implement paging on the get_jobs to get them all if there are more than 50 in queued/running states (50 is the max number we can get in one call). Same, probably good enough for most usages ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
