AmourST commented on issue #825: dolphin如何避免巨量节点任务导致DAG图过于复杂的问题
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/825#issuecomment-533088717
 
 
   > 节点重复计算,会耗费多余的资源与时间,如果业务允许的话,可以进行逻辑拆分,如节点A进行数据落地,其他工作流中的节点直接读取, 
仍然存在重复读取,但是避免了重复计算
   
   那相当于节点a的下游节点必须在一个工作流中,可以这么理解吗?
   节点a下有20个节点,这20个节点又各有自己的子节点,那不就节点膨胀,DAG图变得庞大无比,给运维和可视来说,都造成巨大的障碍

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to