I know what you said, there maybe need more people to discuss this topic, I want to know other's opinion, how do they think this question
Best Regards --------------- DolphinScheduler(Incubator) PPMC Lidong Dai 代立冬 dailidon...@gmail.com --------------- GabryWu <wu_shao_...@qq.com> 于2020年5月19日周二 上午7:19写道： > not actually. I mean refactor backend code to remove DAG, where only JOB > and DEPENDENCY remained > > ---Original--- > *From:* "lidong dai"<dailidon...@gmail.com> > *Date:* Mon, May 18, 2020 22:47 PM > *To:* "GabryWu"<wu_shao_...@qq.com>; > *Cc:* "dev"<dev@dolphinscheduler.apache.org>; > *Subject:* Re: How do you think Task DAG dependency and List dependency？ > > I think your said is "List dependency", List dependency is also DAG, it's > only different in use. when use List dependency, you can add your upstream > dependency for the task, this is convenient for hugely tasks in one > workflow > > > Best Regards > --------------- > DolphinScheduler(Incubator) PPMC > Lidong Dai 代立冬 > dailidon...@gmail.com > --------------- > > > GabryWu <wu_shao_...@qq.com> 于2020年5月13日周三 上午11:08写道： > >> Until now ,DAG is one physical concept， which means that DAG is heavy >> class , and introduces other classes and stored in a big json field. >> On the bigdata platform , DAG is not a good concept for Schedulers, which >> can be abandoned. >> If DAG was abandoned, JOB and DEPENDENCY will simply the architecture >> and make DolphinScheduler stabilize and extended easily and easier to >> search jobs >> However abandoning DAG doesn't mean remove DAG graph in the front end, >> which is also an important visualization way for JOBs >> We can add one Job and Dependency manually ,and visualize them in DAG >> graph automatically >> >> >> >> ------------------ 原始邮件 ------------------ >> *发件人:* "lidong dai"<dailidon...@gmail.com>; >> *发送时间:* 2020年5月12日(星期二) 下午5:26 >> *收件人:* "dev"<dev@dolphinscheduler.apache.org>; >> *主题:* Re: How do you think Task DAG dependency and List dependency？ >> >> yes, your description is proper, thanks >> >> >> Best Regards >> --------------- >> DolphinScheduler(Incubator) PPMC >> Lidong Dai 代立冬 >> dailidon...@gmail.com >> --------------- >> >> >> leon bao <leon...@apache.org> 于2020年5月12日周二 下午5:06写道： >> >> > i think you want to show the DAG using list mode. >> > DS show DAG using graphic mode, that will have some problems: >> > >> > 1. once the number of tasks is large, graphic mode will be confusing. >> > 2. it is difficult to find the specified task in a complex DAG. >> > >> > lidong dai <dailidon...@gmail.com> 于2020年5月12日周二 下午4:31写道： >> > >> > > I want to say do we need to implement List dependency？ >> > > >> > > >> > > >> > > Best Regards >> > > --------------- >> > > DolphinScheduler(Incubator) PPMC >> > > Lidong Dai 代立冬 >> > > dailidon...@gmail.com >> > > --------------- >> > > >> > > >> > > JUN GAO <gaojun2...@gmail.com> 于2020年5月12日周二 下午12:26写道： >> > > >> > > > Hi , @lidong dai >> > > > Sorry , I don`t know your mean about this . >> > > > You want to discuss how to implement Task DAG dependency and List >> > > > dependency ? Or discuss what is Task DAG dependency and List >> > dependency ? >> > > > you can show us what`s your need and ideas , So that we can know the >> > > topic >> > > > of discussion. >> > > > >> > > > Thank you ! >> > > > >> > > > lidong dai <dailidon...@gmail.com> 于2020年5月11日周一 下午10:34写道： >> > > > >> > > > > hi ， >> > > > > >> > > > > Task dependency between upstream and downstream called List >> > > > dependency >> > > > > do you have ideas about this topic? >> > > > > >> > > > > >> > > > > >> > > > > Best Regards >> > > > > --------------- >> > > > > DolphinScheduler(Incubator) PPMC >> > > > > Lidong Dai 代立冬 >> > > > > dailidon...@gmail.com >> > > > > --------------- >> > > > > >> > > > >> > > > >> > > > -- >> > > > >> > > > DolphinScheduler(Incubator) PPMC >> > > > Jun Gao 高俊 >> > > > gaojun2...@gmail.com >> > > > >> > > >> > >> > >> > -- >> > DolphinScheduler(Incubator) PPMC >> > BaoLiang 鲍亮 >> > leon...@apache.org >> > >> >>
