dstandish edited a comment on issue #19346: URL: https://github.com/apache/airflow/issues/19346#issuecomment-1046065769
@hojatbay > What if I don't want to or I cannot increase the timeout period? In my case I need to retry for a period of 24 hours so if I increase the timeout to 24 hours then the task will not release the slot in my environment for 24 hours (its basically a running task that takes 24 hours to complete). As other similar tasks come in, they also take some slots and my environment finally ends up with too many running tasks and causing other issues. This is a very obvious case for deferrable operators: https://airflow.apache.org/docs/apache-airflow/stable/concepts/deferring.html#:~:text=A%20deferrable%20operator%20is%20one,to%20something%20called%20a%20Trigger. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
