zeddit commented on issue #21867: URL: https://github.com/apache/airflow/issues/21867#issuecomment-2268855751
@potiuk great thanks for your reply. I learned about it. As a summary here, at the time point now, there may be a lack of support for implementing a repeating loop of tasks. I known that airflow relies on the DAG abstraction and there should not be loops, but it's a common use case. In the history, `subdagoperator` could achieve this goal by retrying at the entire dag level, however, it was deprecated and I found `subdagoperator` works not well on kubernetesExecutor. For now, `task group` take over `subdagoperator` but it doesn't support `retries` at the whole task group level. So would you mind to give some advices on how to work around this use case in the current version of airflow, I think that would be good for new comers to learn and find some solutions before someone take up this feature. great thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
