cconlyou opened a new issue #1903: [Feature] Add task trigger to start up its depended on processes immediately URL: https://github.com/apache/incubator-dolphinscheduler/issues/1903 As far as I know, every DAG auto run is initiated by a time trigger. If the relationship between jobs is very complex and cannot be easily implemented in one DAG. Although we can split into multiple DAGs through "dependency", these splited DAG can only be started by time trigger and failed retry policy. If the time setting is early, the polling takes up resources. If the time setting is late, there will be some time wasted. ---- 据我所知,每个DAG自动运行都是由时间触发器启动的。如果作业之间的关系非常复杂,不能轻易在一个DAG中实现时,虽然可以通过"依赖"拆解为多个DAG,但是拆解后的DAG只能通过时间触发以及失败重试策略来启动。如果时间设置早了,就挂起轮询占用资源。如果设置晚了,中间会存在空档期。 能否考虑在每个任务完成时主动扫描其依赖项,如果其下游依赖项均满足,会立刻触发。
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
