stephen-bracken opened a new issue, #74660: URL: https://github.com/apache/airflow/issues/74660
### Description The [RetryDecision](https://github.com/apache/airflow/blob/main/task-sdk/src/airflow/sdk/definitions/retry_policy.py#L71) interface for task policies does not support Rescheduling as an option. In our KubernetesPodOperator tasks we Reschedule the task if a capacity constraint is encountered ( NamespaceQuota is full, Nodes are unavailable for scheduling ). We do this because at the start of the day our kubernetes cluster remains full of airflow pods for an extended period of time. If we want to convert our tasks to use the RetryPolicy API then we will need to be able to select a `RetryAction.RESCHEDULE` option, as our tasks are rescheduled ~ every 10 minutes when capacity is unavailable, and it may be several hours before capacity becomes available. To use the retry policy with this mechanism would require setting an unreasonable number of retries on our tasks. ### Use case/motivation Add a `RetryAction.RESCHEDULE` option to the `RetryDecision` and `RetryPolicy` interfaces, update the execution interface to reschedule task instances when a `RetryAction.RESCHEDULE` is received. ### Related issues - #67118 ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
