potiuk commented on issue #29648: URL: https://github.com/apache/airflow/issues/29648#issuecomment-1437918635
> As an alternative and maybe simpler feature it'd also suit my use case if we could make it so that we are optionally able to "reset" the execution timer when the task resumes from deferral. Does that sound more reasonable? Not really - because the task can be resumed from deferral for different reasons. Many od the deferred tasks will have several different resumable functions - and might go through different stages. For example they can run few times resume in function a, different number of times in function b (both quick usually) , then they can run for a long time in function c and then make another several times resume in function d (also quick usually). Each of those resumed runs would have different expectations on how long they can run on its own - some of the checks will be quick. some of them might take longer. So if you would like to have timeout separately for ach resume, you would have to add a feature of having different timeout configured for each resumed function. And that get's rather complex to configure, manage, and to keep control of. I think the cumulative time is the only "reasonable" approach but as @andrewgodwin confirmed - it's non-trivial and inconsistent with sensors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
