collinmcnulty opened a new issue, #38304:
URL: https://github.com/apache/airflow/issues/38304

   ### Description
   
   I think Airflow should have a configureable number of attempts for 
re-attempting to launch a task if it was killed for being stuck in queued for 
too long. Currently, such re-attempts consume task retries, but these are 
conceptually distinct from a task failing to run at all.
   
   ### Use case/motivation
   
   On a certain task that happens to not be idempotent, an Airflow user sets 
retries to zero intentionally, as a human will need to examine if the task can 
be safely retried or if manual intervention is necessary. However, if the same 
task is killed for being stuck in queued, the task never started, so the lack 
of idempotency does not matter and the task should definitely be re-attempted. 
Airflow currently does not allow a user to express this set of preferences.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to