collinmcnulty commented on code in PR #43520:
URL: https://github.com/apache/airflow/pull/43520#discussion_r1842556180
##########
airflow/config_templates/config.yml:
##########
@@ -2331,6 +2331,14 @@ scheduler:
type: integer
example: ~
default: "8974"
+ num_stuck_in_queued_retries:
Review Comment:
task queued timeout consumes the retries on the task as set by the dag
author. This is a problem when the task is not idempotent and therefore
deliberately has retries set to 0. But the particular failure of a task to even
get to running should not actually consume the task's retries that are for the
running of the task. So we still need the timeout setting, but we also need a
separate counter for attempts to get from queued to running, whereas retries
are attempts to get from running to success.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
