Re: [PROPOSAL] Online meeting training about Apache release(including LICENSE/NOTICE) and open source workflow

Wow, that's great. Look forward to it. lidong dai 于2019年9月20日周五 上午11:43写道： > very Good，We will study hard！ > > Thank you！ > 2019-09-20 > — > DolphinScheduler(Incubator) > Lidong Dai 代立冬 > > lidong@outlook.com > > — > > > > On 09/20/2019

Re: [Document Discussion] Dolphin Scheduler of PMC report for October2019

It`s a good idea Guo William 于2019年9月29日周日 上午10:35写道： > Lidong, > > > Agree your idea. > > > Other people opinion? > > Dolphin Scheduler (Incubator) > William Guo Wei > > 原始邮件 > 发件人: lidong dai > 收件人: dev@dolphinscheduler.apache.org > 发送时间: 2019年9月26日(周四) 20:03 > 主题: Re:[Document Discussion] Do

Re: Re: [ANNOUNCE] Apache DolphinScheduler(Incubating) 1.2.0 test build (round 3) available

+1 李 岗 于2019年11月27日周三 下午7:11写道： > +1 > I have checked and not found problems. > > > DolphinScheduler(Incubator) PPMC > Gang Li 李岗 > > lgcareer2...@outlook.com > > From: qiao zhanwei > Date: 2019-11-

Re: 回复: [VOTE] Release Apache DolphinScheduler (Incubating) 1.2.0

+1 I checked The release files have the word incubating in their name The 3rd party jars in the pom.xml All software dependencies are mentioned in LICENSE or NOTICE The DISCLAIMER file exist dehai_zh...@163.com 于2019年12月3日周二 下午5:00写道： > +1 > > > > dehai_zh...@163.com > > 发件人： 李 岗 > 发送时间： 2019-12

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.2.0 (round 2)

+1 I checked The release files have the word incubating in their name All software dependencies are mentioned in LICENSE or NOTICE The DISCLAIMER file exist Elon Lo 于2019年12月7日周六 下午12:19写道： > +1 > I checked > - Download links are valid. > - Checksums and PGP signatures verify correct. > - LICENS

Re: Re: A proposal for DolphinScheduler- refactor WorkerServer/MasterServer

because master schedule the dag, so if a master is down , the dag need to recover at another master node . Then the master need get the dag from db and find the task which is running . This tasks is running on some worker nodes , if tasks status is change ,the worker need know which master node is

Re: A proposal for DolphinScheduler- refactor WorkerServer/MasterServer

Worker-server is not using lock or connecting db anymore. And it can execute task concurrently. it`s a good idea. About fault tolerance I have some ideas: 1、worker node done: Here are some key processes: a、In the task instance table , master can get the task`s running workernode. b、worker node re

[Proposal] develops an ambari plugin about DS

Helle everyone, I would like to develop an ambari plugin about DolpinScheduler. Using this plugin can help those who manage the cluster with ambari to install DS very easy. Backgroud Many companies now use ambari to manage their big data clusters，A ambari plugin about DolpinScheduler c

Re: Aproposal for DolphinScheduler Simplified Deployment

I have some idea: 1. Remove the alert service and change it to a tool jar package. Whether it is the master or the worker, who needs to send a message calls the alert interface. 2. The alert service no longer scans the db and provides an interface. What is sent is determined by the caller. The aler

Re: [Proposal] develops an ambari plugin about DS

Hello, I create an issue about this proposal . https://github.com/apache/incubator-dolphinscheduler/issues/1469 JUN GAO 于2019年12月11日周三 下午7:21写道： > Helle everyone, > > I would like to develop an ambari plugin about DolpinScheduler. Using > this plugin can help those who manage

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.2.1

pos/dist/dev/incubator/dolphinscheduler/KEYS>>>; > > > >> > Look at here for how to verify this release candidate: > >> > > https://dolphinscheduler.apache.org/en-us/docs/development/release.html > >> > > >> > The vote will be open for at least 72 hours or until > necessary number of > >> > votes are reached. > >> > > >> > Please vote accordingly: > >> > > >> > [ ] +1 approve > >> > > >> > [ ] +0 no opinion > >> > [ ] -1 disapprove with the reason > >> > > >> > Checklist for reference: > >> > > >> > [ ] Download links are valid. > >> > > >> > [ ] Checksums and PGP signatures are valid. > >> > > >> > [ ] DISCLAIMER is included. > >> > > >> > [ ] Source code artifacts have correct names matching the > current > >> release. > >> > > >> > [ ] LICENSE and NOTICE files are correct for each > DolphinScheduler repo. > >> > > >> > [ ] All files have license headers if necessary. > >> > > >> > [ ] No compiled archives bundled in source archive. > >> > > >> > More detail checklist  please refer: > >> > > >> > > >> > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > >> > <https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist>>>; > > > >> > > >> > DolphinScheduler(Incubator) PPMC > >> > Gang Li 李岗 > >> > > >> > lgcareer2...@outlook.com<mailto:lgcareer2...@outlook.com>; > >> > > >> > > > > > > -- > > DolphinScheduler(Incubator)  PPMC > > BaoLiang 鲍亮 > > leon...@apache.org > > > > > -- > DolphinScheduler(Incubator)  PPMC > BaoLiang 鲍亮 > leon...@apache.org -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.2.1

refer: > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > > DolphinScheduler(Incubator) PPMC > Gang Li 李岗 > > lgcareer2...@outlook.com<mailto:lgcareer2...@outlook.com> > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: 回复： [DISCUSSION] Is it allowed to change the resource file suffix when update resource name?

esource name,Is it allowed to change the > > resource file suffix when update resource name? > > > > If it is allowed to change the resource file suffix,May be lead to a > > problem that the tasks those which used this resource maybe executed > > failure. > > If it is no

Re: How do you think Task DAG dependency and List dependency？

g Dai 代立冬 > dailidon...@gmail.com > --- > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: 回复： [DISCUSSION] Is it allowed to change the resource file suffix when update resource name?

sed the resource file, > > then we can't simply think the suffix is wrong.  > > who should make this decision that the suffix is wrong ? > > > > > > -- 原始邮件 -- > > 发件人: "JUN GAO" > 发送时间: 2020年5月11日(星期一) 中午1:27 > > 收件人: &q

Re: Re: [PROPOSAL][Feature] Support plugin in Alert service

dependencies) in a single jar file, and put the jar file in some specific > place, such as $DS_HOME/plugins. After that, when start Alert service, the > plugins can be recognized and loaded. So user can choose the alert method > in the portal. > > > > Currently, I've done some investigations, and if this feature is > accepted, I think maybe I can implement it. > > > > Firstly, I'd better to adapt the current function, which is send mail > and something like that. > > > > Then, we can add some more features, such as Alert handler instance, > which is created to describe the alert information(email/slack/wechat/..., > to whom, the title, content, and etc…). > > > > BTW, email and webhook are used frequently. I think they can be the > default plugin, and written in the source code, instead of a jar file. > > Thanks, > hgaol > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [PROPOSAL][Feature] Support plugin in Alert service

ins in alert module, as > for others like SMS(which may has different api), make it as a plugin jar > file. > > Hi @Jun Gao, yes! I also use the SPI feature, it is quite convenient. > Developers just need to implement the interfaces in SPI, which are in > `dolphinscheduler-plugin-api`

Re: [PROPOSAL][Feature] Support plugin in Alert service

In addition to the job can be plugged in, is there any other content that can be plugged in? If so, we need to consider the structural design in advance, because this is a very important design transformation, we can spend more time to think more JUN GAO 于2020年5月13日周三 上午10:11写道： > @hg

Re: [SUGGESTION]Release branch management

t;> > >> 建议解决方案: > >> > 1、建立发版分支的时机，如果想进入发版流程，dev分支暂时不要合入新的feature，暂时只修改bug，尽量把大的改动都在dev分支完成，不要在新的发版分支上面做大的调整，尽可能减少和dev冲突部分。 > >> 2、建立新的发版分支后，所有bug > fix都尽量引导到新的发版分支上，建议对发版分支的issue增加tag来标记，合入的时候也优先合入这部分pr，增加社区的发版参与度。 > >> 3、建立新的发版分支后，允许较大改动新功能的合入，并且如果是在dev上的bug fix尽量往发版分支上引导。 > >> 4、发版分支的改动，应该尽快merge到dev分支，避免后期一起合入的困难，因为自己的改动如果冲突很容易判断应该合入哪个，到最后的话会很难。 > >> > >> > >> Best Regards > >> --- > >> DolphinScheduler(Incubator) Committer > >> Xiaochun Liu 刘小春 > >> liuxiaoc...@apache.org > >> --- > >> > >> > >> > > > > > > > > > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Notice] please don't use fastjson in new PR

't use > fastjson in your new PR ， please use jackson if you want to use json > parser > tool > > > > Best Regards > --- > DolphinScheduler(Incubator) PPMC > Lidong Dai 代立冬 > dailidon...@gmail.com > --- > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

[Poprosal] DolphinScheduler Plugin

我只简单的完成了邮件告警的改造，还需要微信告警插件改造。 3. 钉钉告警插件改造。 4. 企业微信告警的改造。 5. 打包时需要把插件放到特殊的插件目录中。 6. ... -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Poprosal] DolphinScheduler Plugin

In the early days, I thought about returning the json string of the parameter directly through the interface at the plugin layer. However, during our use, we found that some plug-in developers added the parameter type that the front-end ui does not s

Re: [Poprosal] DolphinScheduler Plugin

Regards > --- > DolphinScheduler(Incubator) Committer > Xiaochun Liu 刘小春 > liuxiaoc...@apache.org > --- > > > > > 2020年6月2日 下午3:04，JUN GAO 写道： > > > > https://github.com/gaojun2048/incubator-dolphinscheduler/pull/1 < > https:/

Re: [enhancment]Sqoop component optimization

and other parameters used in specific situations > • Add option button to choose, custom script or use template script, > refer to the design of DataX node > > If the idea is feasible, I will implement this. > > > Best > > > Eights-Li 黄立 > huang...@changan.com.cn > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: 答复: [Poprosal] DolphinScheduler Plugin

gt; > 3. Define the message sending format, {"tos":"soft...@sina.com", > > "content":"taskA failed."} > > 4. Send http request. > http://192.168.1.1:8080/sendMsg/email?data={ > > "tos":"soft...@sina.c

Re: 回复： [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.0

acts have correct names matching the current > release. > > > > [ ] LICENSE and NOTICE files are correct for each > DolphinScheduler repo. > > > > [ ] All files have license headers if necessary. > > > > [ ] No compiled archives bundled in source archive. > > > > More detail checklist  please refer: > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > > > -- > > DolphinScheduler(Incubator)  PPMC > > BaoLiang 鲍亮 > > leon...@apache.org > > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: 回复： [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.0

+1 release files in correct location? release files have the word incubating in their name? the digital signature and hashes correct? DISCLAIMER file exist? JUN GAO 于2020年6月10日周三 上午10:52写道： > +1 > > wu shaoj 于2020年6月10日周三 上午10:45写道： > >> +1 >> >> On

Re: 回复： [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.0

Sorry, I forgot to delete the question mark. Sheng Wu 于2020年6月10日周三 上午11:00写道： > JUN GAO 于2020年6月10日周三 上午10:56写道： > > > +1 > > > > release files in correct location? > > > > release files have the word incubating in their name? > > &g

Re: Re: [Poprosal] DolphinScheduler Plugin

itecture and will attract more > developers. > > so i think the plug-in is suitable for DS. > > > lgcareer2...@outlook.com 于2020年6月10日周三 > 下午4:48写道： > > > @jun gao > > So great to decouple the upper core logic of DS from the specific > > implementation.

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.0 (ROUND2)

SCLAIMER is included. > > > > [ ] Source code artifacts have correct names matching the current > release. > > > > [ ] LICENSE and NOTICE files are correct for each DolphinScheduler repo. > > > > [ ] All files have license headers if necessary. > > > > [ ] No compiled archives bundled in source archive. > > > > More detail checklist please refer: > > > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > -- > > DolphinScheduler(Incubator) PPMC > > BaoLiang 鲍亮 > > leon...@apache.org > > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

[Proposal] Alert Plugin Design

邮件告警功能的完善。 8. 从老版本升级相关的工具开发。 欢迎对这个issue感兴趣的小伙伴参与讨论和开发贡献。 -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Proposal] Alert Plugin Design

Hi, @许昌群 I agree with you, But now DS only support alert for workflow instance can not support alert for task. So we can only config different alert group for workflow instance. changqun.xu 于2020年6月24日周三 下午5:58写道： > > Hi JUN GAO > > It’s a very good design, and I’d like want a fe

Re: [Proposal] Alert Plugin Design

and the configurable > template by using Apache Freemarker? > The advantage of this is user can choose the default template, and also > can write their customized template for their email. > > > Best, > Yichao Yang > > > ---------- 原始邮件 -- > 发件人: &qu

Re: [Proposal] Alert Plugin Design

biao Xiang 向偲彪 > 790061...@qq.com > > > ---------- 原始邮件 -- > 发件人: "JUN GAO" 发送时间: 2020年6月24日(星期三) 下午4:33 > 收件人: "dev" > 主题: [Proposal] Alert Plugin Design > > > > Hi All, This is a part of the [Proposal] DolphinScheduler Plugin Des

Re: [Proposal] Alert Plugin Design

@向偲彪 I read the document of http://www.form-create.com/ , It`s a good web ui tool for DS Plugin-in . I will update the code in package org.apache.dolphinscheduler.spi.params I noticed that the license of form-create is MIT, so don’t forget to add the reference of the license. JUN GAO 于2020年6月

Re: [Vote] Pull Request Title Specification

fication: > > [`Pull Request Type`-`Issue No`][`Module Name`] `Pull Request Description` > > example： > > [Fix-][server] Fix the xxx exception > > [Feature-][server] Implement xxx > > ... > > Pull Request Type 类型在 [1] 中截图给出。 > > > > > 如果想选第一种作为Pull request 标题，则回复1，第二种则回复2。没有其他意见或者建议的话，7天之后默认以第一种作为 Pull > Request 规范。 > > > > > [1] Pull Request Type: > https://github.com/apache/incubator-dolphinscheduler-website/pull/147 > > > > > Best, > > Yichao Yang -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Proposal] Alert Plugin Design

@向偲彪 I finished update the web ui to form-create. JUN GAO 于2020年6月30日周二 下午1:44写道： > @向偲彪 I read the document of > http://www.form-create.com/ , It`s a good web ui tool for DS Plugin-in . > I will update the code in package org.apache.dolphinscheduler.spi.params > > I n

Re: [Proposal] Alert Plugin Design

@qiao zhanwei Can you help me create a branch for this proposal ? JUN GAO 于2020年7月9日周四 下午7:24写道： > @向偲彪 I finished update the web ui to form-create. > > JUN GAO 于2020年6月30日周二 下午1:44写道： > >> @向偲彪 I read the document of >> http://www.form-create.com/ , It`s a good w

Re: [DISCUSS] Issue and Pull Request specifications design

t; Issue TypePull Request TypeExample(Suppose Issue No is ) > > Feature > Feature > > [Feature-][server] Implement xxx > Bug > Hotfix > > [Hotfix-][server] Fix xxx > Improvement > Improvement > > [Improvement-][alert] Improve the performance of xxx > Test > Test > > [Test-][

Add repository incubator-dolphinscheduler-maven-plugin

pom file of the project ,The pluginloader can find the module identified by dolphinscheduler-plugin, then can load this module`s class files and its dependent third-party jars from the target/classes dir of the plug-in module. This will debug locally. -- DolphinScheduler(Incubator) PPMC Jun Gao

Re: Add repository incubator-dolphinscheduler-maven-plugin

The incubator-dolphinscheduler-maven-plugin related issues are https://github.com/apache/incubator-dolphinscheduler/issues/3049 JUN GAO 于2020年7月9日周四 下午9:18写道： > Hi @lidong dai @leon...@apache.org > @lgcareer2...@outlook.com > > > We need to add a repository

Re: [Proposal] Alert Plugin Design

version. Does anyone interested in this feature want to participate in this feature? You can reply to the email to pick up the tasks you are interested in. JUN GAO 于2020年7月9日周四 下午7:32写道： > @qiao zhanwei > > Can you help me create a branch for this proposal ? > > JUN GAO 于2020年

Re: Add repository incubator-dolphinscheduler-maven-plugin

epo.html > > > > Best Regards > --- > DolphinScheduler(Incubator) PPMC > Lidong Dai 代立冬 > dailidon...@gmail.com > --- > > > JUN GAO 于2020年7月9日周四 下午9:21写道： > > > The incubator-dolphinscheduler-maven-plugin related issues are > >

Re: [Proposal] Alert Plugin Design

Hi @YiChao Yang . That`s great ! Yichao Yang <1048262...@qq.com> 于2020年7月15日周三 下午1:03写道： > Hi, > I am interested in 2, I will create an issue about this subtask. >  Thx a lot. > > > Best, > Yichao Yang > > > -- Original -- &g

Re: [Proposal] Alert Plugin Design

determining the version number later Then modify the version number Thank you! JUN GAO 于2020年7月15日周三 下午1:37写道： > Hi @YiChao Yang . > That`s great ! > > > Yichao Yang <1048262...@qq.com> 于2020年7月15日周三 下午1:03写道： > >> Hi, >> I am interested in 2, I will create an iss

Re: Add repository incubator-dolphinscheduler-maven-plugin

Thank you very much! Sheng Wu 于2020年7月15日周三 下午2:00写道： > Created, good luck. > > Sheng Wu 吴晟 > Twitter, wusheng1108 > > > JUN GAO 于2020年7月15日周三 下午12:59写道： > >> Hi. >> >> @Sheng Wu : >> Could you help us to create a new repository named >> i

Re: [DISCUSS] Use element-ui or iview to support form-create in plugin design part

https://lists.apache.org/thread.html/recfe00e9a3c442a7ca3f454dc6ced86130a1719cefe64cf49baef098%40%3Cdev.dolphinscheduler.apache.org%3E > > > Best, > Yichao Yang -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

[DISCUSS] Upgrade tool for upgrade to alert plugin version from the old version

, and then automatically create the default alert group and alert plugin instance and associate the alert group with the workflow define ？ -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Proposal] Alert Plugin Design

server will automatically send a notification asynchronously. Do you have any suggestions? DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

[VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0

://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0

+1 I checked Download links are valid. DISCLAIMER is included. Source code artifacts have correct names matching the current release. LICENSE and NOTICE files are correct for each DolphinScheduler repo. No compiled archives bundled in source archive. JUN GAO 于2020年7月28日周二 上午11:48写道： > He

[RESULT][VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0

Hi DolphinScheduler community, The vote to release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 has PASSED. Here is the vote result, 3 +1 votes 0 +/-0 votes 0 -1 votes 3 +1 votes from PPMC member: - Jun Gao - Lidong Dai - Gang Li -- DolphinScheduler(Incubator) PPMC

Re: [DISCUSS] UT specification of DS

。 > > 举个例子：如果ut用来测试一个api的整个流程，其中需要考虑的条件判断会非常多，去吧每一种条件都考虑到会比较难。但是如果我们将每个ut只正对对应的方法上，并将这个方法覆盖尽可能完全，那么功能性测试的错误率会大大降低。 > > > 2.关于zk，前端测试，（可以包含数据库） > 模块：将这部分的测试放在e2e模块 > 原因：因为这些都是数据端对端的测试，利于模块划分。 > > > If you have any opinions or suggestions, welcome to put forward. > > > Best, > Yichao Yang -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [ANNOUNCE] CheckStyle specifications

duler/blob/dev/style/checkstyle.xml > > [2]  > > > https://github.com/apache/incubator-dolphinscheduler/blob/dev/style/intellij-java-code-style.xml > > > > > > Best, > > Yichao Yang > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: Whether SqlTask should send notifications or not through the alert server

nserts an alert data into the table t_ds_alert, and > then the alert server will automatically send a notification asynchronously. > > > >I think the first solution is better > >In this way, tasks can be synchronized to know whether the message > was sent successfully or not, and can be fault-tolerant based on the results > > > >Do you have any suggestions? > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

[VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 (ROUND2)

://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 (ROUND2)

+1 I checked Download links are valid. DISCLAIMER is included. Source code artifacts have correct names matching the current release. LICENSE and NOTICE files are correct for each DolphinScheduler repo. No compiled archives bundled in source archive. All files have license header. JUN GAO 于

Re: [VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 (ROUND2)

ailto:lgcareer2...@outlook.com> > > From: JUN GAO > Date: 2020-08-08 09:12 > To: dev > Subject: Re: [VOTE] Release Apache DolphinScheduler Maven Plugin > (Incubating) 1.0.0 (ROUND2) > +1 > > I checked > > Download links are valid. > DISCLAIMER is included. &g

[VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 (ROUND3)

h repo. [ ] All files have license headers if necessary. [ ] No compiled archives bundled in source archive. More detail checklist please refer: https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist-- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 (ROUND3)

Hi all. The Maven 2 staging repository is wrong. The right Maven 2 staging repository is : https://repository.apache.org/content/repositories/orgapachedolphinscheduler-1039/org/apache/dolphinscheduler/dolphinscheduler-maven-plugin/1.0.0/ JUN GAO 于2020年8月10日周一 下午3:12写道： > Hello DolphinSchedu

Re: [VOTE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0 (ROUND3)

. LICENSE files are correct for binary archive. NOTICE file are correct for source code archive. NOTICE files are correct for binary archive. All files has license header. No compiled archives bundled in source archive. JUN GAO 于2020年8月10日周一 下午3:17写道： > Hi all. > The Maven 2 staging repository is

Re: [Proposal] Alert Plugin Design

; wenhe...@apache.org > ------------ > > > JUN GAO 于2020年7月20日周一 下午3:53写道： > > > Hi all . > > > > In this feature, we will put the function of sending email into the alert > > email plugin. But I found that SqlTask directly calls the code for > sending >

Re: [DISCUSS][SUMMER-2020] Modify the search rules of task instances

nstanceStateByUser > > > 对于前两个方法，在任务实例较少的时候用户感受并不明显。但是实例较多的时候，没有开始时间的任务实例总是在最后一页。 > > > > 而对于最后一个方法，因为是使用开始时间是否在某一个时间段内为标准进行查找的，没有开始时间的任务实例永远不会被统计到。这时用户就会发现处于延迟执行状态的任务数量总是0。 > > > 由于以上两个原因，我想把以上三个方法从使用开始时间变为使用提交时间。对此我的疑问是，这样的改动对系统影响大不大？ -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.2

d in source archive. More detail checklist  please refer: https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist Best Regards --- DolphinScheduler(Incubator) PPMC Zhanwei Qiao 乔占卫 qiaozhan...@outlook.com --- -- DolphinScheduler(Incubator

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.2

ree. > > > > DolphinScheduler(Incubator) PPMC > Gang Li 李岗 > > lgcareer2...@outlook.com > <mailto:lgcareer2...@outlook.com><mailto:lgcareer2...@outlook.com > <mailto:lgcareer2...@outlook.com>> > > From: JUN GAO > Date: 2020-08-19 08:15 >

Re: discuss next version what to do

Alert plugin-in > 2020年8月19日 下午8:18，Yichao Yang <1048262...@qq.com> 写道： > > Hi, > > > Workflow version control +1. > > > Best, > Yichao Yang > > > > > -- 原始邮件 -- > 发件人: >

Re: discuss next version what to do

Alert plugin-in > 2020年8月19日 下午8:18，Yichao Yang <1048262...@qq.com> 写道： > > Hi, > > > Workflow version control +1. > > > Best, > Yichao Yang > > > > > -- 原始邮件 -- > 发件人: >

Re: About the high availability implementation of the Alert service

存在启动多个alert 服务时，会重复发送告警信息的问题。 > 告警服务挂掉，ds告警功能失效的问题。 > 目前我想到了两种架构来解决重复发送告警信息的问题，同时实现alert moduler高可用功能。 > 1.第一种是alert 服务之间通过zk 实现主从关系，只有主节点来负责信息发送，在主节点挂掉后，重新选主，新的主节点来继续提供告警服务。 > 2.第二种采用去中心的设计，alert 服务 之间通过排它锁来实现所有alert 服务同时工作，并在这种情况下保证告警信息不重复发送。 > 如果大家有更好的方案，可以一起讨论 > > 谢谢 > > > > > fe...@thinkingdata.cn > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: About the high availability implementation of the Alert service

g. > > Best, > Yichao Yang > > > ---------- Original -- > From: JUN GAO Date: Sat,Aug 22,2020 9:41 PM > To: dev Subject: Re: About the high availability implementation of the Alert > service > > > > I think the first one is better. > > fe...

[ANNOUNCE] Release Apache DolphinScheduler Maven Plugin (Incubating) 1.0.0

Hi all, We are glad to announce the release of Apache DolphinScheduler Maven Plugin(incubating) 1.0.0. Once again I would like to express my thanks to your help. Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system, dedicated to solving the complex depend

Recreate branch alert_plugin_design from barnch dev

Hi, everyone Because the branch alert_plugin_design is too old than branch dev. And it have no pull request be merged in branch alert_plugin_design. So I will delete this branch and recreate it from dev. Best Regards --- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2

Re: discuss next version what to do

What about Alert Plugin ? Best Regards --- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com --- > 2020年8月27日 下午2:08，qiaozhan...@outlook.com 写道： > > sorry , I personally consider important tasks > > 1，Api Server communicate for Master

Re: [VOTE]next version what to do

--- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com --- > 2020年9月2日 上午1:04，CalvinKirs 写道： > > 2:Alert module support service for other service invoke(@qiaozhanwei > @gaojun_2048)

Re: We need to find a time to focus on the current issue and pr

need to be modified, but the author > It has > > not been updated for a long time. In this case, we should close it; > some > > are not responding). The accumulation of too many PRs and issues will > > affect the trust of users in the community and also affect the > continuous > > contribution of contributors. Please Refer to Open Source Society: > > Measuring the health of open source projects. > > Best&nbsp; wishes！ > > CalvinKirs -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Future]register center support SPI

tcd. If you > have > > other good ideas, welcome Communicate. > > Best wishes！ > > CalvinKirs > > > > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [remote][bug]netty-heartbeat

Hi, CalvinKirs Can you introduce your design ideas ？ I am very interested in this. Best Regards --- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com --- > 2020年9月25日 上午11:02，CalvinKirs 写道： > > I will finish it, using netty idle way >

Re: [question] resource problem storage

egards --- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com --- > 2020年9月28日 下午1:54，lidong dai 写道： > > please leave message if anyone have ideas > > > > Best Regards > --- > DolphinScheduler(Incubator) PPMC > Li

Re: [DISCUSS]Which charset should we choose in mysql?

UTF8 +1 yongqing <597365...@qq.com> 于2020年10月11日周日 下午12:08写道： > +1 > > > > > -- 原始邮件 -- > 发件人: > "dev" > < > acm_mas...@163.com>; > 发送时间: 2020年9月30日(星

Re: [Question][Alert-SPI] Discussion on the interface scheme of the alarm module support service

netty +1 boyi 于2020年10月21日周三 下午3:33写道： > hi: > > > Now many services are using spring. If you consider scalability > > > I think restful is more extensible > > > > > Nettry is better from a performance point of view > restful > netty > > > -- > BoYi ZhangE-mai

Re: [Question][Alert-SPI] SqlTask should send notifications by alert server api,Alert server address configuration discussion

I think put the alertserver address into the configuration file of the worker or master is better now. zhuangchong6 于2020年10月27日周二 上午9:48写道： > https://github.com/apache/incubator-dolphinscheduler/issues/3997 > > > > Describe the question > In the case of the SqlTask task, the task needs to send

Re: [Question][Alert-SPI] SqlTask should send notifications by alert server api,Alert server address configuration discussion

Is registration center can use now ? If registration center is ready, registration center is better. CalvinKirs 于2020年10月27日周二 上午9:57写道： > registration center +1 > Hello, I think the registration center is relatively more flexible, and it > can also help us manage the online and offline of alert

[ANNOUNCE] Welcome to our new committer: Qiang Guo

Hi Qiang Guo, Welcome you to join us as a new committer. The PPMC for Apache DolphinScheduler has invited Qiang Guo to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to the project since there is no need to go via the patch su

Re: [DISCUSS] [SPI] register center #3961

Registration center SPI is a good idea. CalvinKirs 于2020年10月23日周五 上午9:58写道： > Thx, I understand what you mean, but the discussion here is to design the > registry to be extensible. Our users can use etcd or other solutions > instead of zk. Do you have any good suggestions for the registration ce

Re: [VOTE] Release Apache DolphinScheduler (Incubating) 1.3.3

license headers if necessary. > > [ ] No compiled archives bundled in source archive. > > More detail checklist  please refer: > > > https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist > > > > DolphinScheduler(Incubator) PPMC > Gang Li 李岗 > > lgcar...@apache.org > > > > -- > DolphinScheduler(Incubator) PPMC > BaoLiang 鲍亮 > leon...@apache.org > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [DISCUSS]Which part of DolphinScheduler can be more scalable?

aa2f336fcf28934e7bbb2c3f97fe5fe3d%40%3Cdev.dolphinscheduler.apache.org%3E > https://github.com/apache/incubator-dolphinscheduler/issues/3961 > > - 日志插件 > 目前的日志是通过写服务器本地文件的形式记录的，是不是可以把这个做成插件类型，方便用户扩展日志读写类型，比如写到数据库或者其他第三方系统中。 > > - 全局队列插件 > > > > > 目前任务是被存储在master的内存队列，这就导致了任务的优先级只能在一定范围内起作用，为了让任务的优先级在全局有效，我们需要一种全局队列来让全局优先级起作用。(比如1.2版本我们使用的zookeeper作为全局队列,后面因为zk操作的延时性我们去掉了这个)。 > > 实现细节可以在每个话题内部进行讨论，在这里我们只讨论需求，希望大家可以提出更多意见。 > > -- > DolphinScheduler(Incubator) PPMC > BaoLiang 鲍亮 > leon...@apache.org > > > > -- > DolphinScheduler(Incubator) PPMC > BaoLiang 鲍亮 > leon...@apache.org > > > > -- > DolphinScheduler(Incubator) PPMC > BaoLiang 鲍亮 > leon...@apache.org > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE][New Jar] jetcd-core(registry plugin support etcd3

ncher > > > > > > > The vote will be open for at least 72 hours or until necessary number of > votes are reached. > > > Please vote accordingly: > > > [ ] +1 approve > > > [ ] +0 no opinion > > > [ ] -1 disapprove with the reason > > > > > Best wishes！ > CalvinKirs > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [Improvement][server] When the tenant does not exist, the task execution should throw an exception

ovement > When the workflow task node is executing, if the tenant does not exist, > the worker execution throws an exception. > > Which version of DolphinScheduler: > -[dev] > > 描述问题 > 工作流任务节点在执行时，如果租户不存在，worker会创建新的租户，我认为此时应该抛出异常，dolphin的安装租户权限大，有操作风险 > > 目前的不足之处和改进的好处 > 工作流任务节点在执行时，如果租户不存在，worker执行抛出异常。 > > 哪个版本的DolphinScheduler： > -[dev] > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [DISCUSS] Graduate Apache DolphinScheduler (incubating) as a TLP

t; > > > [3] https://dolphinscheduler.apache.org/ > > > > [4] https://incubator.apache.org/clutch/dolphinscheduler.html > > > > [5] http://incubator.apache.org/projects/dolphinscheduler.html > > > > [6] > > > > > > > > > > https://cwiki.apache.org/confluence/display/DOLPHINSCHEDULER/DolphinScheduler+Graduation+Checklist > > > > [7] > > > > > > > > > > https://lists.apache.org/thread.html/r79381a3fd38d112b5ccb0be67675547e187497135853b0fe999f813a%40%3Cdev.dolphinscheduler.apache.org%3E > > > > > > > > > > > > Best Regards > > > > > > > > -- > > > > DolphinScheduler(Incubator) PPMC > > > > Gang Li 李岗 > > > > > > > > lgcar...@apache.org > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > Best wishes！ > > > CalvinKirs > > > > > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: Re: [VOTE] Graduate Apache DolphinScheduler (Incubating) as a toplevel project

DolphinScheduler Project, and > to have primary responsibility for management of the projects within the > scope of responsibility of the Apache DolphinScheduler Project; and be it > further RESOLVED, that the persons listed immediately below be and hereby > are appointed to serve as

Re: The graduation resolution submitted

Thank you to the community, thank you to the contribution, thank you > > to everyone. > > > > zhuangchong > > > > > 在 2021年2月20日，10:47，Gang Li 写道： > > > > > > It’s really a good message. Congratulations everyone. > > > > > -- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com

Re: [VOTE][New Jar] poi, poi-ooxml(alert email plugin support xlsx )

+1 Best Regards --- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com --- > 2021年5月12日 下午9:06，Lidong Dai 写道： > > hi， > good feature! > > By the way, Are all jars required? > > > Best Regards > --- >

Re: [VOTE] Add bot mergeable for DolphinScheduler

+1 Best Regards --- DolphinScheduler(Incubator) PPMC Jun Gao 高俊 gaojun2...@gmail.com --- > 2021年11月10日 下午6:35，Jiajie Zhong 写道： > > Hey guys, > > Since this mail thread pass, and we already add bot Mergeable to > our repo. For now it would red

Re: [DISCUSS]Create user mailing list

+1 li gang 于2022年10月21日周五 09:59写道： > +1 > > Jiajie Zhong 于2022年10月19日周三 16:59写道： > > > Hello everyone, > > > > I propose we dolphinscheduler create a user mail list for our users. > > > > The dev mailing list is mainly used by project developers to discuss > > community development-related work