not actually. I mean refactor backend code to remove DAG, where only JOB and DEPENDENCY remained
---Original--- From: "lidong dai"<dailidon...@gmail.com> Date: Mon, May 18, 2020 22:47 PM To: "GabryWu"<wu_shao_...@qq.com>; Cc: "dev"<dev@dolphinscheduler.apache.org>; Subject: Re: How do you think Task DAG dependency and List dependency？ I think your said is "List dependency", List dependency is also DAG, it's only different in use. when use List dependency, you can add your upstream dependency for the task, this is convenient for hugely tasks in one workflow Best Regards --------------- DolphinScheduler(Incubator) PPMC Lidong Dai 代立冬 dailidon...@gmail.com --------------- GabryWu <wu_shao_...@qq.com> 于2020年5月13日周三 上午11:08写道： Until now ,DAG is one physical concept， which means that DAG is heavy class , and introduces other classes and stored in a big json field. On the bigdata platform , DAG is not a good concept for Schedulers, which can be abandoned. If DAG was abandoned, JOB and DEPENDENCY will simply the architecture and make DolphinScheduler stabilize and extended easily and easier to search jobs However abandoning DAG doesn't mean remove DAG graph in the front end, which is also an important visualization way for JOBs We can add one Job and Dependency manually ,and visualize them in DAG graph automatically ------------------ 原始邮件 ------------------ 发件人: "lidong dai"<dailidon...@gmail.com>; 发送时间: 2020年5月12日(星期二) 下午5:26 收件人: "dev"<dev@dolphinscheduler.apache.org>; 主题: Re: How do you think Task DAG dependency and List dependency？ yes, your description is proper, thanks Best Regards --------------- DolphinScheduler(Incubator) PPMC Lidong Dai 代立冬 dailidon...@gmail.com --------------- leon bao <leon...@apache.org> 于2020年5月12日周二 下午5:06写道： > i think you want to show the DAG using list mode. > DS show DAG using graphic mode, that will have some problems: > > 1. once the number of tasks is large, graphic mode will be confusing. > 2. it is difficult to find the specified task in a complex DAG. > > lidong dai <dailidon...@gmail.com> 于2020年5月12日周二 下午4:31写道： > > > I want to say do we need to implement List dependency？ > > > > > > > > Best Regards > > --------------- > > DolphinScheduler(Incubator) PPMC > > Lidong Dai 代立冬 > > dailidon...@gmail.com > > --------------- > > > > > > JUN GAO <gaojun2...@gmail.com> 于2020年5月12日周二 下午12:26写道： > > > > > Hi , @lidong dai > > > Sorry , I don`t know your mean about this . > > > You want to discuss how to implement Task DAG dependency and List > > > dependency ? Or discuss what is Task DAG dependency and List > dependency ? > > > you can show us what`s your need and ideas , So that we can know the > > topic > > > of discussion. > > > > > > Thank you ! > > > > > > lidong dai <dailidon...@gmail.com> 于2020年5月11日周一 下午10:34写道： > > > > > > > hi ， > > > > > > > > Task dependency between upstream and downstream called List > > > dependency > > > > do you have ideas about this topic? > > > > > > > > > > > > > > > > Best Regards > > > > --------------- > > > > DolphinScheduler(Incubator) PPMC > > > > Lidong Dai 代立冬 > > > > dailidon...@gmail.com > > > > --------------- > > > > > > > > > > > > > -- > > > > > > DolphinScheduler(Incubator) PPMC > > > Jun Gao 高俊 > > > gaojun2...@gmail.com > > > > > > > > -- > DolphinScheduler(Incubator) PPMC > BaoLiang 鲍亮 > leon...@apache.org >
