[GitHub] [incubator-dolphinscheduler] leehom opened a new issue #3072: [Feature] sharding or Paralleling task
leehom opened a new issue #3072: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3072 sharding or Paralleling is important feature for for scheduler，i have some idea about that，for ds to implementing sharding or sharding easily。 1. changing the dag to chain，en，we can say it Dimension reducing 2. adding Parallism property to node of chain 3. when buiding the chaining task of the job, api can build dag according to the Parallism of the node at all，something like flink, streaming graph, job graph, execution graph This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] felix-thinkingdata commented on issue #2869: [Proposal] DolphinScheduler Plugin Design
felix-thinkingdata commented on issue #2869: URL: https://github.com/apache/incubator-dolphinscheduler/issues/2869#issuecomment-650924053 very six This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] codecov-commenter commented on pull request #2421: workflow lineage
codecov-commenter commented on pull request #2421: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2421#issuecomment-650921976 # [Codecov](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=h1) Report > Merging [#2421](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=desc) into [dev](https://codecov.io/gh/apache/incubator-dolphinscheduler/commit/e837a73fcd823be5f7488d0b36085a044239defe=desc) will **decrease** coverage by `0.11%`. > The diff coverage is `10.47%`. [](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=tree) ```diff @@ Coverage Diff @@ ##dev#2421 +/- ## - Coverage 35.89% 35.78% -0.12% - Complexity 2401 2407 +6 Files 424 428 +4 Lines 1955919664 +105 Branches 2385 2396 +11 + Hits 7021 7036 +15 - Misses1191312005 +92 + Partials625 623 -2 ``` | [Impacted Files](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...e/dolphinscheduler/dao/entity/WorkFlowLineage.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1kYW8vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvZGFvL2VudGl0eS9Xb3JrRmxvd0xpbmVhZ2UuamF2YQ==) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | | | [.../dolphinscheduler/dao/entity/WorkFlowRelation.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1kYW8vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvZGFvL2VudGl0eS9Xb3JrRmxvd1JlbGF0aW9uLmphdmE=) | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | | | [...nscheduler/api/service/WorkFlowLineageService.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1hcGkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvYXBpL3NlcnZpY2UvV29ya0Zsb3dMaW5lYWdlU2VydmljZS5qYXZh) | `2.17% <2.17%> (ø)` | `1.00 <1.00> (?)` | | | [...uler/api/controller/WorkFlowLineageController.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1hcGkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvYXBpL2NvbnRyb2xsZXIvV29ya0Zsb3dMaW5lYWdlQ29udHJvbGxlci5qYXZh) | `10.52% <10.52%> (ø)` | `2.00 <2.00> (?)` | | | [.../org/apache/dolphinscheduler/api/enums/Status.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1hcGkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvYXBpL2VudW1zL1N0YXR1cy5qYXZh) | `100.00% <100.00%> (ø)` | `5.00 <0.00> (ø)` | | | [...eduler/dao/datasource/SpringConnectionFactory.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1kYW8vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvZGFvL2RhdGFzb3VyY2UvU3ByaW5nQ29ubmVjdGlvbkZhY3RvcnkuamF2YQ==) | `100.00% <100.00%> (ø)` | `8.00 <1.00> (+1.00)` | | | ... and [1 more](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=footer). Last update [e837a73...5f7ee96](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread
wa-ooo commented on issue #3065: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650893544 用户管理中可以对资源赋权，如果用户选择了其他租户运行任务就会报错 == Resources can be weighted in user management and an error will be reported if the user selects another tenant to run the task This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread
wa-ooo commented on issue #3065: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650893003 那为什么要在工作流中使用选择租户而不是用户绑定的租户。既然可以选择那么可以认为用户和租户是1-N的关系 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread
wa-ooo commented on issue #3065: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650892952 > Yes, the tenant running the workflow needs to be the same as the tenant who created the resource file Then why use tenant selection in the workflow instead of tenant user binding. Now that you have a choice you can think of the relationship between the user and the tenant as 1-n This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2924: In the case of multiple network cards, a valid host is returned
sonarcloud[bot] commented on pull request #2924: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-650891547 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) [1 Security Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [4 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [64.1% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2924: In the case of multiple network cards, a valid host is returned
sonarcloud[bot] removed a comment on pull request #2924: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-650726773 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) [1 Security Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [4 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [64.1% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2884: batch copy or move process #2753
sonarcloud[bot] commented on pull request #2884: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2884#issuecomment-650881931 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL) [4 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list) [70.7% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list) [0.4% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2884: batch copy or move process #2753
sonarcloud[bot] removed a comment on pull request #2884: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2884#issuecomment-650679955 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL) [4 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list) [70.7% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list) [0.4% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] break60 commented on pull request #3068: Select and drag dag
break60 commented on pull request #3068: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3068#issuecomment-650873371 Please don't change the code style of dag.vue page, otherwise I don't know what you changed This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] adadfa2 commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
adadfa2 commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650872543 > > > If using 1.2.1, use 1.2.1-release version > > > https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java > > >  > > > > > > 1.2.1-release version is ok ，But I see that the 1.3 tag still has the same problem ==》https://github.com/apache/incubator-dolphinscheduler/blob/1.3.0/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java > > Hi, > Because we move the dependent task to master server, you can check this commit [1]. > > [1][4946e88](https://github.com/apache/incubator-dolphinscheduler/commit/4946e88872ef943b5d0a739f213831daca3facd8) Oh, thanks, we tested the latest version and 1.2.1-release version This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] adadfa2 closed issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
adadfa2 closed issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] whitelowrie closed issue #3070: [BUG] have not enough thread when I just run one workflow
whitelowrie closed issue #3070: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3070 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
yangyichao-mango commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650871614 > > If using 1.2.1, use 1.2.1-release version > > https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java > >  > > 1.2.1-release version is ok ，But I see that the 1.3 tag still has the same problem ==》https://github.com/apache/incubator-dolphinscheduler/blob/1.3.0/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java Hi, Because we move the dependent task to master server, you can check this commit [1]. [1]https://github.com/apache/incubator-dolphinscheduler/commit/4946e88872ef943b5d0a739f213831daca3facd8 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] frankYu001 commented on issue #3071: [Feature]
frankYu001 commented on issue #3071: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3071#issuecomment-650871676 在一个流中多于20个任务节点时，查询指定节点就比较困难，所以建议添加一个查询指定节点的功能，从使用场景上讲，一个流中task数量多是一般情况，有时候我们也确实需要定位到某个指定的task node This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] frankYu001 opened a new issue #3071: [Feature]
frankYu001 opened a new issue #3071: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3071 when there are 20+ tasks in the workflow, we can not find the specified task easily. so I recommend add an function which can search the specified task ,like locate the task node or show task list ,something etc. That is a usual case 20+ tasks in one flow and we sometime really need to locate the specified task. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] adadfa2 commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
adadfa2 commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650870811 > If using 1.2.1, use 1.2.1-release version > > https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java > >  1.2.1-release version is ok ，But I see that the 1.3 tag still has the same problem ==》https://github.com/apache/incubator-dolphinscheduler/blob/1.3.0/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
BoYiZhang commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650870559 now dev branch dependent and conditions has moved to master server This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3027: replace CollectionUtils deprecated method
sonarcloud[bot] removed a comment on pull request #3027: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-650726815 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3027: replace CollectionUtils deprecated method
sonarcloud[bot] commented on pull request #3027: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-650869170 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
BoYiZhang commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650868929 If using 1.2.1, use 1.2.1-release version https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] whitelowrie opened a new issue #3070: [BUG] have not enough thread when I just run one workflow
whitelowrie opened a new issue #3070: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3070 1. when I'm running a workflow that contrain three flume task，I start other workflow，It stay in "waiting for thread"  2. I check the linux Server, I found a lot of threads running by the MasterServer  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] adadfa2 commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT
adadfa2 commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650863797 In version 1.2.1, I got it wrong Remove the version submitted by DEPENDENT here ==》 https://github.com/apache/incubator-dolphinscheduler/commit/7f94122f6eb201375b11e4e681849a66e6c572e4#diff-b75d01d2ea0e1cbee19329bfd4f9d78a This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wacr2008 commented on issue #249: Lineage data kinship（Lineage数据血缘关系）
wacr2008 commented on issue #249: URL: https://github.com/apache/incubator-dolphinscheduler/issues/249#issuecomment-650857342 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.0
BoYiZhang commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650855803 Your code version is wrong version: 1.2.0  https://github.com/apache/incubator-dolphinscheduler/blob/1.2.0-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] BoYiZhang closed issue #3005: [Feature] DataX configures multiple readers and writers through web pages
BoYiZhang closed issue #3005: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3005 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3059: [BUG] Workflow definition display exception
BoYiZhang commented on issue #3059: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3059#issuecomment-650854139 What should I do to avoid it This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] feiyalun commented on issue #3062: It is recommended to modify some of the 1.3.0 table field types
feiyalun commented on issue #3062: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3062#issuecomment-650851171 It will definitely be dismantled in the future. At present, I want to use it for overall testing. If it can run, subtraction will be done in the future.I'd love to, but I can't make it --原始邮件-- 发件人:"Yichao Yang"
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3069: fix single yarn get application status failed
sonarcloud[bot] commented on pull request #3069: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650765303 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [61.5% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3069: fix single yarn get application status failed
sonarcloud[bot] removed a comment on pull request #3069: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754403 SonarCloud Quality Gate failed. [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [1 Code Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [64.3% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 13:59:27 UTC 2020 0c41f0007df0eaffadbcfe52553297f9070994fd
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1677c3e Automated deployment: Sun Jun 28 13:59:27 UTC 2020
0c41f0007df0eaffadbcfe52553297f9070994fd
1677c3e is described below
commit 1677c3ef00578498b0b5621a8abe4f5db287cbef
Author: lenboo
AuthorDate: Sun Jun 28 13:59:28 2020 +
Automated deployment: Sun Jun 28 13:59:27 UTC 2020
0c41f0007df0eaffadbcfe52553297f9070994fd
---
en-us/docs/release/download.html | 12
en-us/docs/release/download.json | 2 +-
2 files changed, 1 insertion(+), 13 deletions(-)
diff --git a/en-us/docs/release/download.html b/en-us/docs/release/download.html
index ed7667a..842eed2 100644
--- a/en-us/docs/release/download.html
+++ b/en-us/docs/release/download.html
@@ -27,18 +27,6 @@
-Jun. 28th, 2020
-1.3.0
-Source code
-https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip;>[src]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc;>[asc]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512;>[sha512]
-
-
-
-
-Binary Distribution
-https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz;>[tar]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc;>[asc]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512;
[...]
-
-
Feb. 24th, 2020
1.2.1
Source code
diff --git a/en-us/docs/release/download.json b/en-us/docs/release/download.json
index b62a7c2..da08911 100644
--- a/en-us/docs/release/download.json
+++ b/en-us/docs/release/download.json
@@ -1,6 +1,6 @@
{
"filename": "download.md",
- "__html": "Download the DolphinScheduler releases\nUse the links
below to download the Apache DolphinScheduler from one of our
mirrors.\nOnly source code releases are official Apache
releases: Windows and Linux binary distributions are just for end user
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\nDownload the DolphinScheduler releases\nUse the links
below to download the Apache DolphinScheduler from one of our
mirrors.\nOnly source code releases are official Apache
releases: Windows and Linux binary distributions are just for end user
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\n
[incubator-dolphinscheduler-website] branch master updated: revert 130 download (#141)
This is an automated email from the ASF dual-hosted git repository. leonbao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git The following commit(s) were added to refs/heads/master by this push: new 0c41f00 revert 130 download (#141) 0c41f00 is described below commit 0c41f0007df0eaffadbcfe52553297f9070994fd Author: bao liang <29528966+len...@users.noreply.github.com> AuthorDate: Sun Jun 28 21:56:35 2020 +0800 revert 130 download (#141) * test * test * change structure of documents * add how to become a committer * update documents * update documents * update * update * update * update chinese to english * add 1.3.0 download links * revert * revert Co-authored-by: baoliang --- docs/en-us/release/download.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/docs/en-us/release/download.md b/docs/en-us/release/download.md index 76dc8cc..35ac840 100644 --- a/docs/en-us/release/download.md +++ b/docs/en-us/release/download.md @@ -8,8 +8,6 @@ Use the links below to download the Apache DolphinScheduler from one of our mirr ## DolphinScheduler | Date | Version| | Downloads | |:---:|:--:|:--:|:--:| -| Jun. 28th, 2020 | 1.3.0 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512)| -| | | Binary Distribution| [[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512)| | Feb. 24th, 2020 | 1.2.1 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.sha512)| | | | Binary Distribution| [[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.sha512)| | Feb. 2th, 2020 | 1.2.0 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.sha512)|
[GitHub] [incubator-dolphinscheduler-website] lenboo opened a new pull request #141: revert 130 download
lenboo opened a new pull request #141: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/141 revert 130 download This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler-website] lenboo merged pull request #141: revert 130 download
lenboo merged pull request #141: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/141 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3069: fix single yarn get application status failed
sonarcloud[bot] commented on pull request #3069: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754403 SonarCloud Quality Gate failed. [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [1 Code Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [64.3% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3069: fix single yarn get application status failed
sonarcloud[bot] removed a comment on pull request #3069: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754058 SonarCloud Quality Gate failed. [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [1 Code Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [64.3% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3069: fix single yarn get application status failed
sonarcloud[bot] commented on pull request #3069: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754058 SonarCloud Quality Gate failed. [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [1 Code Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [64.3% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3068: Select and drag dag
sonarcloud[bot] commented on pull request #3068: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3068#issuecomment-650753791 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3068=coverage=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3068=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3068=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Eights-Li opened a new pull request #3069: fix single yarn get application status failed
Eights-Li opened a new pull request #3069: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069 ## What is the purpose of the pull request *fix single yarn get application status failed* deploy dolphin scheduler in single yarn hadoop cluster, exec a yarn job will lead npe when get the yarn app status ## Brief change log - *Modify HadoopUtils* ## Verify this pull request This pull request is already covered by existing tests, such as: *dolphinscheduler/common/utils/HadoopUtilsTest.java* This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] satcblue opened a new pull request #3068: Select and drag dag
satcblue opened a new pull request #3068: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3068 ## Support to multi drag task ## What is the purpose of the pull request - Convenient for users to drag and drop, when user use the dag, he should drag one by one. Now, he can select one or more by pressing the key of 'ctrl'. ## Brief change log - Add multiDrag.js This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3046: [Feature] Workflow version control
yangyichao-mango commented on issue #3046: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3046#issuecomment-650749192 > @yangyichao-mango any release plan? Hi, I'm working on it, and if you're interested in this, you can follow the mailing list[1]. [1] https://lists.apache.org/thread.html/r4db87136679dc9badf173292e94c10c5097c8f19547d8ac4aa5f5990%40%3Cdev.dolphinscheduler.apache.org%3E This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3061: [QUESTION] task submit succuess but can't continue
yangyichao-mango commented on issue #3061: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3061#issuecomment-650747714 Hi, Can you describe which version and how to reproduce this. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3062: It is recommended to modify some of the 1.3.0 table field types
yangyichao-mango commented on issue #3062: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3062#issuecomment-650747150 > 部分字段长度类型不够，我建议修改一下，因为工作流中一旦有500+task，维护表关系就会报错 Hi~ Will 500+ task appear in a workflow in your current scenario? In my opinion, if one workflow has 500+ task, it should be split to small task first, because it will be clearer and easier to manage. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.0
yangyichao-mango commented on issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650745108 Hi, What you mean is in the version 1.2.0 or bigger than version 1.2.0 Can you describe the detail how to reproduce this bug? Thx a lot. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #3060: Abnormal situation of cluster time display
samz406 commented on issue #3060: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3060#issuecomment-650743368 Please change the title to English and describe your question follow the question line This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #3050: [QUESTION] question title 监控中心那边worker和marter那边的心跳时间比北京时间快5小时，检查了服务器时间，时区，数据库时间都是正确的，请问这个问题要怎么处理？
samz406 commented on issue #3050: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3050#issuecomment-650743159 same issue #3060,i will close This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 closed issue #3050: [QUESTION] question title 监控中心那边worker和marter那边的心跳时间比北京时间快5小时，检查了服务器时间，时区，数据库时间都是正确的，请问这个问题要怎么处理？
samz406 closed issue #3050: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3050 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #3060: Abnormal situation of cluster time display
samz406 commented on issue #3060: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3060#issuecomment-650742320 The worker master reports the heartbeat to obtain the current server time, so you need to check the time of the two servers 49,41 worker master上报心跳是取得当前服务器时间，所以需要你检查下49,41两台服务器时间 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] jxzdoing commented on issue #3066: [QUESTION] Can't set dependency check
jxzdoing commented on issue #3066: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650731219 > Which version？ > Can you describe the steps to reproduce Hi， The DS version is：1.2.1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 10:30:51 UTC 2020 d8ed86840727990ba69d76a8f3b1febe0015ffc4
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 594814e Automated deployment: Sun Jun 28 10:30:51 UTC 2020
d8ed86840727990ba69d76a8f3b1febe0015ffc4
594814e is described below
commit 594814e1b8f35f2ed58ad35681fb22b0193b787b
Author: lgcareer
AuthorDate: Sun Jun 28 10:30:52 2020 +
Automated deployment: Sun Jun 28 10:30:51 UTC 2020
d8ed86840727990ba69d76a8f3b1febe0015ffc4
---
build/blog.js | 2 +-
build/blogDetail.js| 2 +-
build/community.js | 2 +-
build/documentation.js | 4 +-
build/home.js | 2 +-
img/architecture-1.3.0.jpg | Bin 0 -> 392697 bytes
img/process-start-flow-1.3.0.png | Bin 0 -> 224425 bytes
zh-cn/docs/1.3.0/user_doc/architecture-design.html | 353 +
zh-cn/docs/1.3.0/user_doc/architecture-design.json | 6 +
9 files changed, 365 insertions(+), 6 deletions(-)
diff --git a/build/blog.js b/build/blog.js
index a828b7a..48c967a 100644
--- a/build/blog.js
+++ b/build/blog.js
@@ -10,7 +10,7 @@ object-assign
(c) Sindre Sorhus
@license MIT
*/
-var
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
e=new
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
t[e]}).join(""))return!1;var
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
[...]
+var
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
e=new
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
t[e]}).join(""))return!1;var
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
[...]
//! moment.js locale configuration
var t=function(e){return
0===e?0:1===e?1:2===e?2:e%100>=3&%100<=10?3:e%100>=11?4:5},n={s:["أقل من
ثانية","ثانية واحدة",["ثانيتان","ثانيتين"],"%d ثوان","%d ثانية","%d
ثانية"],m:["أقل من دقيقة","دقيقة واحدة",["دقيقتان","دقيقتين"],"%d دقائق","%d
دقيقة","%d دقيقة"],h:["أقل من ساعة","ساعة واحدة",["ساعتان","ساعتين"],"%d
ساعات","%d ساعة","%d ساعة"],d:["أقل من يوم","يوم واحد",["يومان","يومين"],"%d
أيام","%d يومًا","%d يوم"],M:["أقل من شهر","شهر واحد",["شهران","شهرين"],"%d
أشهر","%d شهرا","%d ش [...]
//! moment.js locale configuration
diff --git a/build/blogDetail.js b/build/blogDetail.js
index d2b6167..7ea85c1 100644
--- a/build/blogDetail.js
+++ b/build/blogDetail.js
@@ -10,7 +10,7 @@ object-assign
(c) Sindre Sorhus
@license MIT
*/
-var
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
e=new
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
t[e]}).join(""))return!1;var
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
[...]
+var
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
e=new
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
t[e]}).join(""))return!1;var
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
[...]
//! moment.js locale configuration
var t=function(e){return
0===e?0:1===e?1:2===e?2:e%100>=3&%100<=10?3:e%100>=11?4:5},n={s:["أقل من
ثانية","ثانية واحدة",["ثانيتان","ثانيتين"],"%d ثوان","%d ثانية","%d
ثانية"],m:["أقل من دقيقة","دقيقة واحدة",["دقيقتان","دقيقتين"],"%d دقائق","%d
دقيقة","%d دقيقة"],h:["أقل من ساعة","ساعة واحدة",["ساعتان","ساعتين"],"%d
ساعات","%d ساعة","%d ساعة"],d:["أقل من يوم","يوم واحد",["يومان","يومين"],"%d
أيام","%d يومًا","%d يوم"],M:["أقل من شهر","شهر واحد",["شهران","شهرين"],"%d
أشهر","%d شهرا","%d ش [...]
//! moment.js locale configuration
diff --git a/build/community.js b/build/community.js
index 4659e08..b4c3bb3 100644
--- a/build/community.js
+++ b/build/community.js
@@ -10,7
[GitHub] [incubator-dolphinscheduler-website] lgcareer merged pull request #140: add version 1.3.0 of architecture design
lgcareer merged pull request #140: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/140 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch master updated: add version 1.3.0 of architecture design
This is an automated email from the ASF dual-hosted git repository. lgcareer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git The following commit(s) were added to refs/heads/master by this push: new 9ae7676 add version 1.3.0 of architecture design new d8ed868 Merge pull request #140 from lgcareer/master-1.3.0-doc 9ae7676 is described below commit 9ae7676938d939996905661d3b6419f67138a996 Author: lgcareer <18610854...@163.com> AuthorDate: Sun Jun 28 17:56:42 2020 +0800 add version 1.3.0 of architecture design --- docs/zh-cn/1.3.0/user_doc/architecture-design.md | 331 +++ img/architecture-1.3.0.jpg | Bin 0 -> 392697 bytes img/process-start-flow-1.3.0.png | Bin 0 -> 224425 bytes site_config/docs1-3-0.js | 6 +- site_config/site.js | 2 +- 5 files changed, 335 insertions(+), 4 deletions(-) diff --git a/docs/zh-cn/1.3.0/user_doc/architecture-design.md b/docs/zh-cn/1.3.0/user_doc/architecture-design.md new file mode 100644 index 000..ec5c28a --- /dev/null +++ b/docs/zh-cn/1.3.0/user_doc/architecture-design.md @@ -0,0 +1,331 @@ +## 系统架构设计 +在对调度系统架构说明之前，我们先来认识一下调度系统常用的名词 + +### 1.名词解释 +**DAG：** 全称Directed Acyclic Graph，简称DAG。工作流中的Task任务以有向无环图的形式组装起来，从入度为零的节点进行拓扑遍历，直到无后继节点为止。举例如下图： + + + + +dag示例 + + + +**流程定义**：通过拖拽任务节点并建立任务节点的关联所形成的可视化**DAG** + +**流程实例**：流程实例是流程定义的实例化，可以通过手动启动或定时调度生成,流程定义每运行一次，产生一个流程实例 + +**任务实例**：任务实例是流程定义中任务节点的实例化，标识着具体的任务执行状态 + +**任务类型**： 目前支持有SHELL、SQL、SUB_PROCESS(子流程)、PROCEDURE、MR、SPARK、PYTHON、DEPENDENT(依赖)、，同时计划支持动态插件扩展，注意：其中子 **SUB_PROCESS** 也是一个单独的流程定义，是可以单独启动执行的 + +**调度方式：** 系统支持基于cron表达式的定时调度和手动调度。命令类型支持：启动工作流、从当前节点开始执行、恢复被容错的工作流、恢复暂停流程、从失败节点开始执行、补数、定时、重跑、暂停、停止、恢复等待线程。其中 **恢复被容错的工作流** 和 **恢复等待线程** 两种命令类型是由调度内部控制使用，外部无法调用 + +**定时调度**：系统采用 **quartz** 分布式调度器，并同时支持cron表达式可视化的生成 + +**依赖**：系统不单单支持 **DAG** 简单的前驱和后继节点之间的依赖，同时还提供**任务依赖**节点，支持**流程间的自定义任务依赖** + +**优先级** ：支持流程实例和任务实例的优先级，如果流程实例和任务实例的优先级不设置，则默认是先进先出 + +**邮件告警**：支持 **SQL任务** 查询结果邮件发送，流程实例运行结果邮件告警及容错告警通知 + +**失败策略**：对于并行运行的任务，如果有任务失败，提供两种失败策略处理方式，**继续**是指不管并行运行任务的状态，直到流程失败结束。**结束**是指一旦发现失败任务，则同时Kill掉正在运行的并行任务，流程失败结束 + +**补数**：补历史数据，支持**区间并行和串行**两种补数方式 + +### 2.系统架构 + + 2.1 系统架构图 + + + +系统架构图 + + + + 2.2 启动流程活动图 + + + +启动流程活动图 + + + + 2.3 架构说明 + +* **MasterServer** + +MasterServer采用分布式无中心设计理念，MasterServer主要负责 DAG 任务切分、任务提交监控，并同时监听其它MasterServer和WorkerServer的健康状态。 +MasterServer服务启动时向Zookeeper注册临时节点，通过监听Zookeeper临时节点变化来进行容错处理。 +MasterServer基于netty提供监听服务。 + +# 该服务内主要包含: + +- **Distributed Quartz**分布式调度组件，主要负责定时任务的启停操作，当quartz调起任务后，Master内部会有线程池具体负责处理任务的后续操作 + +- **MasterSchedulerThread**是一个扫描线程，定时扫描数据库中的 **command** 表，根据不同的**命令类型**进行不同的业务操作 + +- **MasterExecThread**主要是负责DAG任务切分、任务提交监控、各种不同命令类型的逻辑处理 + +- **MasterTaskExecThread**主要负责任务的持久化 + +* **WorkerServer** + + WorkerServer也采用分布式无中心设计理念，WorkerServer主要负责任务的执行和提供日志服务。 + WorkerServer服务启动时向Zookeeper注册临时节点，并维持心跳。 + Server基于netty提供监听服务。Worker + # 该服务包含： + - **FetchTaskThread**主要负责不断从**Task Queue**中领取任务，并根据不同任务类型调用**TaskScheduleThread**对应执行器。 + + - **LoggerServer**是一个RPC服务，提供日志分片查看、刷新和下载等功能 + +* **ZooKeeper** + + ZooKeeper服务，系统中的MasterServer和WorkerServer节点都通过ZooKeeper来进行集群管理和容错。另外系统还基于ZooKeeper进行事件监听和分布式锁。 +我们也曾经基于Redis实现过队列，不过我们希望DolphinScheduler依赖到的组件尽量地少，所以最后还是去掉了Redis实现。 + +* **Task Queue** + + 提供任务队列的操作，目前队列也是基于Zookeeper来实现。由于队列中存的信息较少，不必担心队列里数据过多的情况，实际上我们压测过百万级数据存队列，对系统稳定性和性能没影响。 + +* **Alert** + + 提供告警相关接口，接口主要包括**告警**两种类型的告警数据的存储、查询和通知功能。其中通知功能又有**邮件通知**和**SNMP(暂未实现)**两种。 + +* **API** + +API接口层，主要负责处理前端UI层的请求。该服务统一提供RESTful api向外部提供请求服务。 +接口包括工作流的创建、定义、查询、修改、发布、下线、手工启动、停止、暂停、恢复、从该节点开始执行等等。 + +* **UI** + +系统的前端页面，提供系统的各种可视化操作界面，详见系统使用手册部分。 + + 2.3 架构设计思想 + +# 一、去中心化vs中心化 + +## 中心化思想 + +中心化的设计理念比较简单，分布式集群中的节点按照角色分工，大体上分为两种角色： + + https://analysys.github.io/easyscheduler_docs_cn/images/master_slave.png; alt="master-slave角色" width="50%" /> + + +- Master的角色主要负责任务分发并监督Slave的健康状态，可以动态的将任务均衡到Slave上，以致Slave节点不至于“忙死”或”闲死”的状态。 +- Worker的角色主要负责任务的执行工作并维护和Master的心跳，以便Master可以分配任务给Slave。 + + + +中心化思想设计存在的问题： + +- 一旦Master出现了问题，则群龙无首，整个集群就会崩溃。为了解决这个问题，大多数Master/Slave架构模式都采用了主备Master的设计方案，可以是热备或者冷备，也可以是自动切换或手动切换，而且越来越多的新系统都开始具备自动选举切换Master的能力,以提升系统的可用性。 +- 另外一个问题是如果Scheduler在Master上，虽然可以支持一个DAG中不同的任务运行在不同的机器上，但是会产生Master的过负载。如果Scheduler在Slave上，则一个DAG中所有的任务都只能在某一台机器上进行作业提交，则并行任务比较多的时候，Slave的压力可能会比较大。 + + + +## 去中心化 + https://analysys.github.io/easyscheduler_docs_cn/images/decentralization.png; alt="去中心化" width="50%" /> + + +- 在去中心化设计里，通常没有Master/Slave的概念，所有的角色都是一样的，地位是平等的，全球互联网就是一个典型的去中心化的分布式系统，联网的任意节点设备down机，都只会影响很小范围的功能。 +- 去中心化设计的核心设计在于整个分布式系统中不存在一个区别于其他节点的”管理者”，因此不存在单点故障问题。但由于不存在” 管理者”节点所以每个节点都需要跟其他节点通信才得到必须要的机器信息，而分布式系统通信的不可靠性，则大大增加了上述功能的实现难度。 +-
[GitHub] [incubator-dolphinscheduler] jxzdoing commented on issue #3066: [QUESTION] Can't set dependency check
jxzdoing commented on issue #3066: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650730626 > > HI everyone， > > we have a lot of workflow in one project，those workflow was created by time order。when i need to set dependency check in > > a workflow（it depends on a node in another workflow ），It's really strange，in the second select box，I can select the destination workflow，but in the third select box，the nodes display are not belong to the workflow which was selected in the second select box， its' belong to the workflow which was created last time，It's anyone has the same problem? > > the second select box： > >  > > the third select box: > >  > > sometime the dependency does not work! did you mean It's a bug for DS？ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler-website] lgcareer opened a new pull request #140: add version 1.3.0 of architecture design
lgcareer opened a new pull request #140: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/140 add version 1.3.0 of architecture design This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler-website] break60 opened a new pull request #139: Migrating the developer guide below the developer
break60 opened a new pull request #139: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/139 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2924: In the case of multiple network cards, a valid host is returned
sonarcloud[bot] commented on pull request #2924: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-650726773 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) [1 Security Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [4 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [64.1% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3027: replace CollectionUtils deprecated method
sonarcloud[bot] removed a comment on pull request #3027: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-649978022 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2924: In the case of multiple network cards, a valid host is returned
sonarcloud[bot] removed a comment on pull request #2924: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-649978456 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) [1 Security Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [4 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [64.1% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3027: replace CollectionUtils deprecated method
sonarcloud[bot] commented on pull request #3027: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-650726815 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler] branch dev updated: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925) (#2965)
This is an automated email from the ASF dual-hosted git repository.
lidongdai pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler.git
The following commit(s) were added to refs/heads/dev by this push:
new 38e4853 [Feature-2925][server] Init TaskLogger in
TaskExecuteProcessor (#2925) (#2965)
38e4853 is described below
commit 38e485373de9a7301a19f57cb53dbf4cb6744696
Author: Yichao Yang <1048262...@qq.com>
AuthorDate: Sun Jun 28 17:43:13 2020 +0800
[Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)
(#2965)
* [Feature-2925][common] Add exitVal judge in OSUtils.exeCmd (#2925)
* optimize the logger utils
---
.../common/shell/AbstractShell.java| 40 +---
.../dolphinscheduler/common/utils/FileUtils.java | 60 +---
.../dolphinscheduler/common/utils/LoggerUtils.java | 27 +-
.../dolphinscheduler/common/utils/OSUtils.java | 103 -
.../dolphinscheduler/common/utils/OSUtilsTest.java | 6 +-
.../dolphinscheduler/server/log/TaskLogFilter.java | 9 +-
.../worker/processor/TaskExecuteProcessor.java | 42 ++---
.../server/worker/runner/TaskExecuteThread.java| 36 +++
8 files changed, 220 insertions(+), 103 deletions(-)
diff --git
a/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
b/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
index f846b19..aafdb86 100644
---
a/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
+++
b/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
@@ -16,9 +16,6 @@
*/
package org.apache.dolphinscheduler.common.shell;
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-
import java.io.BufferedReader;
import java.io.File;
import java.io.IOException;
@@ -30,6 +27,9 @@ import java.util.TimerTask;
import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.atomic.AtomicBoolean;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
/**
* A base class for running a Unix command.
@@ -128,7 +128,7 @@ public abstract class AbstractShell {
/**
* Run a command actual work
*/
- private void runCommand() throws IOException {
+ private void runCommand() throws IOException {
ProcessBuilder builder = new ProcessBuilder(getExecString());
Timer timeOutTimer = null;
ShellTimeoutTimerTask timeoutTimerTask = null;
@@ -153,11 +153,11 @@ public abstract class AbstractShell {
timeOutTimer.schedule(timeoutTimerTask, timeOutInterval);
}
final BufferedReader errReader =
-new BufferedReader(new InputStreamReader(process
- .getErrorStream()));
-BufferedReader inReader =
-new BufferedReader(new InputStreamReader(process
- .getInputStream()));
+new BufferedReader(
+new InputStreamReader(process.getErrorStream()));
+BufferedReader inReader =
+new BufferedReader(
+new InputStreamReader(process.getInputStream()));
final StringBuilder errMsg = new StringBuilder();
// read error and input streams as this would free up the buffers
@@ -177,23 +177,35 @@ public abstract class AbstractShell {
}
}
};
+Thread inThread = new Thread() {
+ @Override
+ public void run() {
+try {
+ parseExecResult(inReader);
+} catch (IOException ioe) {
+ logger.warn("Error reading the in stream", ioe);
+}
+super.run();
+ }
+};
try {
errThread.start();
+ inThread.start();
} catch (IllegalStateException ise) { }
try {
// parse the output
- parseExecResult(inReader);
- exitCode = process.waitFor();
+ exitCode = process.waitFor();
try {
-// make sure that the error thread exits
+// make sure that the error and in thread exits
errThread.join();
+inThread.join();
} catch (InterruptedException ie) {
-logger.warn("Interrupted while reading the error stream", ie);
+logger.warn("Interrupted while reading the error and in stream", ie);
}
completed.set(true);
//the timeout thread handling
//taken care in finally block
- if (exitCode != 0) {
+ if (exitCode != 0 || errMsg.length() > 0) {
throw new ExitCodeException(exitCode, errMsg.toString());
}
} catch (InterruptedException ie) {
diff --git
a/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/FileUtils.java
b/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/FileUtils.java
index bae8f7f..de3d429 100644
---
[GitHub] [incubator-dolphinscheduler] adadfa2 opened a new issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.0
adadfa2 opened a new issue #3067: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067 version 【1.2.0 】 When choosing to use the dependent node task, an error is reported during execution `[ERROR] 2020-06-28 15:27:22.118-[taskAppId=TASK-341-240188-431977]:[75]-unsupport task type: DEPENDENT` See below https://user-images.githubusercontent.com/38177161/85943967-295d3b00-b966-11ea-8481-ed904fb7bf86.png;> code show as below https://user-images.githubusercontent.com/38177161/85944027-7fca7980-b966-11ea-8d13-e60f4cd3d5c0.png;> ==》https://github.com/apache/incubator-dolphinscheduler/blob/4946e88872ef943b5d0a739f213831daca3facd8/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong closed issue #2925: [BUG] There is no exitVal judge in OSUtils.exeCmd function
dailidong closed issue #2925: URL: https://github.com/apache/incubator-dolphinscheduler/issues/2925 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong merged pull request #2965: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)
dailidong merged pull request #2965: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2965 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong closed issue #3014: [Feature] Init TaskLogger in TaskExecuteProcessor
dailidong closed issue #3014: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3014 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 09:37:55 UTC 2020 088d38aae6daf2f935ed6dc062e60cdb171a7e59
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b0bea0c Automated deployment: Sun Jun 28 09:37:55 UTC 2020
088d38aae6daf2f935ed6dc062e60cdb171a7e59
b0bea0c is described below
commit b0bea0ca902dd0b8701452fc97648b6ff5299091
Author: lgcareer
AuthorDate: Sun Jun 28 09:37:56 2020 +
Automated deployment: Sun Jun 28 09:37:55 UTC 2020
088d38aae6daf2f935ed6dc062e60cdb171a7e59
---
zh-cn/docs/1.3.0/user_doc/metadata-1.3.html | 28 +++-
zh-cn/docs/1.3.0/user_doc/metadata-1.3.json | 2 +-
zh-cn/docs/release/download.html| 12
zh-cn/docs/release/download.json| 2 +-
4 files changed, 33 insertions(+), 11 deletions(-)
diff --git a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
index 876f21f..85b9391 100644
--- a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
+++ b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
@@ -12,7 +12,7 @@
- EnEn
表概览
@@ -249,6 +249,16 @@
datetime
更新时间
+
+modify_by
+varchar
+修改用户
+
+
+resource_ids
+varchar
+资源id集
+
@@ -408,8 +418,8 @@
流程实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest
-worker_group_id
-int
+worker_group
+varchar
任务指定运行的worker分组
@@ -541,8 +551,8 @@
任务实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest
-worker_group_id
-int
+worker_group
+varchar
任务指定运行的worker分组
@@ -614,8 +624,8 @@
流程实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest
-worker_group_id
-int
+worker_group
+varchar
任务指定运行的worker分组
@@ -712,8 +722,8 @@
流程实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest
-worker_group_id
-int
+worker_group
+varchar
任务指定运行的worker分组
diff --git a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
index 02008e9..c68e78d 100644
--- a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
+++ b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
@@ -1,6 +1,6 @@
{
"filename": "metadata-1.3.md",
- "__html": "Dolphin Scheduler 1.2元数据文档\n\n表概览\n\n\n\n表名\n表信息\n\n\n\n\nt_ds_access_token\n访问ds后端的token\n\n\nt_ds_alert\n告警信息\n\n\nt [...]
+ "__html": "Dolphin Scheduler 1.3元数据文档\n\n表概览\n\n\n\n表名\n表信息\n\n\n\n\nt_ds_access_token\n访问ds后端的token\n\n\nt_ds_alert\n告警信息\n\n\nt [...]
"link": "/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html",
"meta": {}
}
\ No newline at end of file
diff --git a/zh-cn/docs/release/download.html b/zh-cn/docs/release/download.html
index eeb7e4e..1436391 100644
--- a/zh-cn/docs/release/download.html
+++ b/zh-cn/docs/release/download.html
@@ -27,6 +27,18 @@
+Jun. 28th, 2020
+1.3.0
+Source code
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip;>[src]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc;>[asc]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512;>[sha512]
+
+
+
+
+Binary Distribution
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz;>[tar]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc;>[asc]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512;
[...]
+
+
Feb. 24th, 2020
1.2.1
Source code
diff --git a/zh-cn/docs/release/download.json b/zh-cn/docs/release/download.json
index 8d37dda..1fe6570 100644
--- a/zh-cn/docs/release/download.json
+++ b/zh-cn/docs/release/download.json
@@ -1,6 +1,6 @@
{
"filename": "download.md",
- "__html": "下载DolphinScheduler发布版本\n使用下面的链接,从Apache
DolphinScheduler的镜像下载。\n只有源码包属于Apache官方发布包，二进制发布包只是为了方便用户使用。\nDolphinScheduler\n\n\n\n日期\n版本\n\n下载\n\n\n\n\nFeb. 24th, 2020\n1.2.1< [...]
+ "__html": "下载DolphinScheduler发布版本\n使用下面的链接,从Apache
DolphinScheduler的镜像下载。\n只有源码包属于Apache官方发布包，二进制发布包只是为了方便用户使用。\nDolphinScheduler\n\n\n\n日期\n版本\n\n下载\n\n\n\n\nJun. 28th, 2020\n1.3.0< [...]
"link": "/zh-cn/docs/release/download.html",
"meta": {}
}
\ No newline at end of file
[GitHub] [incubator-dolphinscheduler-website] lgcareer opened a new pull request #138: add metadata-1.3 and update download page
lgcareer opened a new pull request #138: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/138 add metadata-1.3 and update download page This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch master updated: add metadata-1.3 and update download page
This is an automated email from the ASF dual-hosted git repository. lgcareer pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git The following commit(s) were added to refs/heads/master by this push: new da5467e add metadata-1.3 and update download page new 088d38a Merge pull request #138 from lgcareer/master-1.3.0-doc da5467e is described below commit da5467ed9245acacb722fab15421ec4fd2775d6e Author: lgcareer <18610854...@163.com> AuthorDate: Sun Jun 28 17:32:56 2020 +0800 add metadata-1.3 and update download page --- docs/zh-cn/1.3.0/user_doc/metadata-1.3.md | 12 +++- docs/zh-cn/release/download.md| 2 ++ 2 files changed, 9 insertions(+), 5 deletions(-) diff --git a/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md b/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md index 09a14ae..e298b48 100644 --- a/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md +++ b/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md @@ -1,4 +1,4 @@ -# Dolphin Scheduler 1.2元数据文档 +# Dolphin Scheduler 1.3元数据文档 ### 表概览 @@ -75,6 +75,8 @@ | timeout | int | 超时时间 | | tenant_id | int | 租户id | | update_time | datetime | 更新时间 | +| modify_by | varchar | 修改用户 | +| resource_ids | varchar | 资源id集 | t_ds_process_instance @@ -109,7 +111,7 @@ | history_cmd | text | 历史命令，记录所有对流程实例的操作 | | dependence_schedule_times | text | 依赖节点的预估时间 | | process_instance_priority | int | 流程实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest | -| worker_group_id | int | 任务指定运行的worker分组 | +| worker_group | varchar | 任务指定运行的worker分组 | | timeout | int | 超时时间 | | tenant_id | int | 租户id | @@ -138,7 +140,7 @@ | retry_interval | int | 重试间隔 | | max_retry_times | int | 最大重试次数 | | task_instance_priority | int | 任务实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest | -| worker_group_id | int | 任务指定运行的worker分组 | +| worker_group | varchar | 任务指定运行的worker分组 | t_ds_schedules @@ -155,7 +157,7 @@ | warning_type | tinyint | 告警类型：0 不发,1 流程成功发,2 流程失败发,3 成功失败都发 | | warning_group_id | int | 告警组id | | process_instance_priority | int | 流程实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest | -| worker_group_id | int | 任务指定运行的worker分组 | +| worker_group | varchar | 任务指定运行的worker分组 | | create_time | datetime | 创建时间 | | update_time | datetime | 更新时间 | @@ -177,7 +179,7 @@ | dependence | varchar | 依赖字段 | | update_time | datetime | 更新时间 | | process_instance_priority | int | 流程实例优先级：0 Highest,1 High,2 Medium,3 Low,4 Lowest | -| worker_group_id | int | 任务指定运行的worker分组 | +| worker_group | varchar | 任务指定运行的worker分组 | diff --git a/docs/zh-cn/release/download.md b/docs/zh-cn/release/download.md index b0df434..c0b7af0 100644 --- a/docs/zh-cn/release/download.md +++ b/docs/zh-cn/release/download.md @@ -7,6 +7,8 @@ ## DolphinScheduler | 日期 | 版本| | 下载 | |:---:|:--:|:--:|:--:| +| Jun. 28th, 2020 | 1.3.0 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512)| +| | | Binary Distribution| [[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512)| | Feb. 24th, 2020 | 1.2.1 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.sha512)| | | | Binary Distribution| [[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.sha512)| | Jan. 2th, 2020 | 1.2.0 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.asc)
[GitHub] [incubator-dolphinscheduler-website] lgcareer merged pull request #138: add metadata-1.3 and update download page
lgcareer merged pull request #138: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/138 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #3066: [QUESTION] Can't set dependency check
xingchun-chen commented on issue #3066: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650724948 Which version？ Can you describe the steps to reproduce This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3066: [QUESTION] Can't set dependency check
super-sponge commented on issue #3066: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650723215 > HI everyone， > we have a lot of workflow in one project，those workflow was created by time order。when i need to set dependency check in > a workflow（it depends on a node in another workflow ），It's really strange，in the second select box，I can select the destination workflow，but in the third select box，the nodes display are not belong to the workflow which was selected in the second select box， its' belong to the workflow which was created last time，It's anyone has the same problem? > the second select box： >  > > the third select box: >  sometime the dependency does not work! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge removed a comment on issue #3063: [QUESTION] worker get yarn application status failed
super-sponge removed a comment on issue #3063: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722984 > We have made changes to support multiple yarn clusters, using YARN CLI to obtain the state of the application does single yarn runing normal? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3063: [QUESTION] worker get yarn application status failed
super-sponge commented on issue #3063: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722984 > We have made changes to support multiple yarn clusters, using YARN CLI to obtain the state of the application does single yarn runing normal? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge edited a comment on issue #3063: [QUESTION] worker get yarn application status failed
super-sponge edited a comment on issue #3063:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722697
> > it occured when not enable HA. you should change HadoopUtils.Java code
add appUrl = appAddress;
> > ```
> > } else {
> > //single resourcemanager enabled
> > appUrl = appAddress;
> > yarnEnabled = true;
> > }
> > ```
>
> It's a bug. If not fit that bug, single resourcemanager application status
url is blank String, will lead to error as above.
yes! fix the code ,build and replace the jar
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3063: [QUESTION] worker get yarn application status failed
super-sponge commented on issue #3063:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722697
> > it occured when not enable HA. you should change HadoopUtils.Java code
add appUrl = appAddress;
> > ```
> > } else {
> > //single resourcemanager enabled
> > appUrl = appAddress;
> > yarnEnabled = true;
> > }
> > ```
>
> It's a bug. If not fit that bug, single resourcemanager application status
url is blank String, will lead to error as above.
yes!
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread
xingchun-chen commented on issue #3065: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650722641 Yes, the tenant running the workflow needs to be the same as the tenant who created the resource file This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] jxzdoing opened a new issue #3066: [QUESTION] Can't set dependency check
jxzdoing opened a new issue #3066: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3066 HI everyone， we have a lot of workflow in one project，those workflow was created by time order。when i need to set dependency check in a workflow（it depends on a node in another workflow ），It's really strange，in the second select box，I can select the destination workflow，but in the third select box，the nodes display are not belong to the workflow which was selected in the second select box， its' belong to the workflow which was created last time，It's anyone has the same problem?  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] hlzhu1983 commented on issue #3063: [QUESTION] worker get yarn application status failed
hlzhu1983 commented on issue #3063:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650719612
> it occured when not enable HA. you should change HadoopUtils.Java code add
appUrl = appAddress;
>
> ```
> } else {
> //single resourcemanager enabled
> appUrl = appAddress;
> yarnEnabled = true;
> }
> ```
It's a bug. If not fit that bug, single resourcemanager application status
url is blank String, will lead to error as above.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3063: [QUESTION] worker get yarn application status failed
wa-ooo commented on issue #3063: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650719000 We have made changes to support multiple yarn clusters, using YARN CLI to obtain the state of the application This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wa-ooo opened a new issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread
wa-ooo opened a new issue #3065: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3065 Why use the tenant configuration of the workflow in the downloadResource method of TaskExecuteThread. If a user is given resource permissions in user management, but the tenant of the running workflow is not a tenant of the resource, an error is reported that the resource file is not retrieved == TaskExecuteThread的downloadResource 方法中使用工作流的租户配置。如果在用户管理中给用户分配了资源权限，但是运行的工作流的租户并不是资源上传用户的租户，那么就会报获取不到资源文件的错误 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2965: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)
sonarcloud[bot] commented on pull request #2965: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2965#issuecomment-650716692 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL) [2 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list) [49.5% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2965: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)
sonarcloud[bot] removed a comment on pull request #2965: URL: https://github.com/apache/incubator-dolphinscheduler/pull/2965#issuecomment-650296143 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY) (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT) to review) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL) [2 Code Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list) [49.5% Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list) [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list) [0.0% Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 07:13:43 UTC 2020 9e8d53c8a7b1151289dcc604a0497472f0d98b3b
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 4e2e427 Automated deployment: Sun Jun 28 07:13:43 UTC 2020
9e8d53c8a7b1151289dcc604a0497472f0d98b3b
4e2e427 is described below
commit 4e2e42783c5cff22d127135b65ab86797b5c6186
Author: lenboo
AuthorDate: Sun Jun 28 07:13:43 2020 +
Automated deployment: Sun Jun 28 07:13:43 UTC 2020
9e8d53c8a7b1151289dcc604a0497472f0d98b3b
---
en-us/docs/release/download.html | 12
en-us/docs/release/download.json | 2 +-
2 files changed, 13 insertions(+), 1 deletion(-)
diff --git a/en-us/docs/release/download.html b/en-us/docs/release/download.html
index 842eed2..ed7667a 100644
--- a/en-us/docs/release/download.html
+++ b/en-us/docs/release/download.html
@@ -27,6 +27,18 @@
+Jun. 28th, 2020
+1.3.0
+Source code
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip;>[src]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc;>[asc]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512;>[sha512]
+
+
+
+
+Binary Distribution
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz;>[tar]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc;>[asc]
https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512;
[...]
+
+
Feb. 24th, 2020
1.2.1
Source code
diff --git a/en-us/docs/release/download.json b/en-us/docs/release/download.json
index da08911..b62a7c2 100644
--- a/en-us/docs/release/download.json
+++ b/en-us/docs/release/download.json
@@ -1,6 +1,6 @@
{
"filename": "download.md",
- "__html": "Download the DolphinScheduler releases\nUse the links
below to download the Apache DolphinScheduler from one of our
mirrors.\nOnly source code releases are official Apache
releases: Windows and Linux binary distributions are just for end user
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\nDownload the DolphinScheduler releases\nUse the links
below to download the Apache DolphinScheduler from one of our
mirrors.\nOnly source code releases are official Apache
releases: Windows and Linux binary distributions are just for end user
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\n
[GitHub] [incubator-dolphinscheduler-website] lenboo merged pull request #137: add 1.3.0 download links
lenboo merged pull request #137: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/137 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-dolphinscheduler-website] branch master updated: add 1.3.0 download links (#137)
This is an automated email from the ASF dual-hosted git repository. leonbao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git The following commit(s) were added to refs/heads/master by this push: new 9e8d53c add 1.3.0 download links (#137) 9e8d53c is described below commit 9e8d53c8a7b1151289dcc604a0497472f0d98b3b Author: bao liang <29528966+len...@users.noreply.github.com> AuthorDate: Sun Jun 28 15:10:32 2020 +0800 add 1.3.0 download links (#137) * test * test * change structure of documents * add how to become a committer * update documents * update documents * update * update * update * update chinese to english * add 1.3.0 download links Co-authored-by: baoliang --- docs/en-us/release/download.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/en-us/release/download.md b/docs/en-us/release/download.md index 35ac840..76dc8cc 100644 --- a/docs/en-us/release/download.md +++ b/docs/en-us/release/download.md @@ -8,6 +8,8 @@ Use the links below to download the Apache DolphinScheduler from one of our mirr ## DolphinScheduler | Date | Version| | Downloads | |:---:|:--:|:--:|:--:| +| Jun. 28th, 2020 | 1.3.0 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512)| +| | | Binary Distribution| [[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512)| | Feb. 24th, 2020 | 1.2.1 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.sha512)| | | | Binary Distribution| [[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.sha512)| | Feb. 2th, 2020 | 1.2.0 | Source code| [[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip) [[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.asc) [[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.sha512)|
[GitHub] [incubator-dolphinscheduler-website] lenboo opened a new pull request #137: add 1.3.0 download links
lenboo opened a new pull request #137: URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/137 add 1.3.0 download links This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge edited a comment on issue #3063: [QUESTION] worker get yarn application status failed
super-sponge edited a comment on issue #3063:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650707983
it occured when not enable HA. you should changeHadoopUtils.Java
code add appUrl = appAddress;
} else {
//single resourcemanager enabled
appUrl = appAddress;
yarnEnabled = true;
}
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3063: [QUESTION] worker get yarn application status failed
super-sponge commented on issue #3063:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650707983
HadoopUtils.Java 207 lines
} else {
//single resourcemanager enabled
appUrl = appAddress;
yarnEnabled = true;
}
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
svn commit: r40204 - /release/incubator/dolphinscheduler/KEYS
Author: leonbao Date: Sun Jun 28 06:34:50 2020 New Revision: 40204 Log: transfer KEYS for 1.3.0 Added: release/incubator/dolphinscheduler/KEYS - copied unchanged from r40203, dev/incubator/dolphinscheduler/KEYS
svn commit: r40203 - /release/incubator/dolphinscheduler/KEYS
Author: leonbao Date: Sun Jun 28 06:34:19 2020 New Revision: 40203 Log: delete KEYS Removed: release/incubator/dolphinscheduler/KEYS
[GitHub] [incubator-dolphinscheduler] whitelowrie opened a new issue #3064: [BUG] com.sun.jna.platform.win32.Win32Exception: 占位程序接收到错误数据。when the WorkerServer work in the Windows
whitelowrie opened a new issue #3064: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3064 When I'm running the workerServer in Windows 10 System，I schedule a simple program like `dir` then the task run fail，and get some exception  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
svn commit: r40202 - /dev/incubator/dolphinscheduler/1.3.0/ /release/incubator/dolphinscheduler/1.3.0/
Author: leonbao Date: Sun Jun 28 06:08:25 2020 New Revision: 40202 Log: transfer packages for 1.3.0 Added: release/incubator/dolphinscheduler/1.3.0/ - copied from r40201, dev/incubator/dolphinscheduler/1.3.0/ Removed: dev/incubator/dolphinscheduler/1.3.0/
svn commit: r40200 - /release/incubator/dolphinscheduler/KEYS
Author: leonbao Date: Sun Jun 28 06:07:48 2020 New Revision: 40200 Log: delete KEYS Removed: release/incubator/dolphinscheduler/KEYS
svn commit: r40201 - /release/incubator/dolphinscheduler/KEYS
Author: leonbao Date: Sun Jun 28 06:08:13 2020 New Revision: 40201 Log: transfer KEYS for 1.3.0 Added: release/incubator/dolphinscheduler/KEYS - copied unchanged from r40200, dev/incubator/dolphinscheduler/KEYS
