victorfuzaro commented on issue #21867: URL: https://github.com/apache/airflow/issues/21867#issuecomment-1675509424
> one thing I'm wondering is consider the following situation <img alt="image" width="626" src="https://user-images.githubusercontent.com/114772123/260165377-8c603ac9-b13e-4094-b7cf-4e9041dca376.png";> D just failed and B is still running. I already know that I'll need to retry the task group, should I cancel B ? If I let it complete, should I also let C run even if I know I'll re-run it ? > > What I'm leaning towards is that (assuming we're in "retry if any failed" policy) as soon as a task fails, we stop everything and restart from the beginning, but I wonder if there is any bad side effect to that. I personally would let B complete instead of cancelling it, just to avoid some garbage/corrupted results that can surge when cancelling a task in the middle of its execution. C and E shouldn't run. That's one idea, another one would be adding something like a parameter that allows the cancelation of any running task. So the user could choose if he wants running tasks cancelled or wait their completion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
![https://user-images.githubusercontent.com/114772123/260165377-8c603ac9-b13e-4094-b7cf-4e9041dca376.png"](https://user-images.githubusercontent.com/114772123/260165377-8c603ac9-b13e-4094-b7cf-4e9041dca376.png"){kind=link}