[GitHub] [incubator-dolphinscheduler] leehom opened a new issue #3072: [Feature] sharding or Paralleling task

2020-06-28 Thread GitBox


leehom opened a new issue #3072:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3072


  sharding or  Paralleling is important feature for for scheduler,i have 
some idea about that,for ds to implementing sharding or sharding easily。
   1. changing the dag to chain,en,we can say it Dimension reducing
   2. adding Parallism property to node of chain
   3. when buiding the chaining task of the job, api can build dag according to 
the Parallism of the node
   at all,something like flink,  streaming graph, job graph,  execution graph



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] felix-thinkingdata commented on issue #2869: [Proposal] DolphinScheduler Plugin Design

2020-06-28 Thread GitBox


felix-thinkingdata commented on issue #2869:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/2869#issuecomment-650924053


   very six



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] codecov-commenter commented on pull request #2421: workflow lineage

2020-06-28 Thread GitBox


codecov-commenter commented on pull request #2421:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2421#issuecomment-650921976


   # 
[Codecov](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=h1)
 Report
   > Merging 
[#2421](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=desc)
 into 
[dev](https://codecov.io/gh/apache/incubator-dolphinscheduler/commit/e837a73fcd823be5f7488d0b36085a044239defe=desc)
 will **decrease** coverage by `0.11%`.
   > The diff coverage is `10.47%`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/graphs/tree.svg?width=650=150=pr=bv9iXXRLi9)](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ##dev#2421  +/-   ##
   
   - Coverage 35.89%   35.78%   -0.12% 
   - Complexity 2401 2407   +6 
   
 Files   424  428   +4 
 Lines 1955919664 +105 
 Branches   2385 2396  +11 
   
   + Hits   7021 7036  +15 
   - Misses1191312005  +92 
   + Partials625  623   -2 
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=tree)
 | Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[...e/dolphinscheduler/dao/entity/WorkFlowLineage.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1kYW8vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvZGFvL2VudGl0eS9Xb3JrRmxvd0xpbmVhZ2UuamF2YQ==)
 | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | |
   | 
[.../dolphinscheduler/dao/entity/WorkFlowRelation.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1kYW8vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvZGFvL2VudGl0eS9Xb3JrRmxvd1JlbGF0aW9uLmphdmE=)
 | `0.00% <0.00%> (ø)` | `0.00 <0.00> (?)` | |
   | 
[...nscheduler/api/service/WorkFlowLineageService.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1hcGkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvYXBpL3NlcnZpY2UvV29ya0Zsb3dMaW5lYWdlU2VydmljZS5qYXZh)
 | `2.17% <2.17%> (ø)` | `1.00 <1.00> (?)` | |
   | 
[...uler/api/controller/WorkFlowLineageController.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1hcGkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvYXBpL2NvbnRyb2xsZXIvV29ya0Zsb3dMaW5lYWdlQ29udHJvbGxlci5qYXZh)
 | `10.52% <10.52%> (ø)` | `2.00 <2.00> (?)` | |
   | 
[.../org/apache/dolphinscheduler/api/enums/Status.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1hcGkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvYXBpL2VudW1zL1N0YXR1cy5qYXZh)
 | `100.00% <100.00%> (ø)` | `5.00 <0.00> (ø)` | |
   | 
[...eduler/dao/datasource/SpringConnectionFactory.java](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree#diff-ZG9scGhpbnNjaGVkdWxlci1kYW8vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2RvbHBoaW5zY2hlZHVsZXIvZGFvL2RhdGFzb3VyY2UvU3ByaW5nQ29ubmVjdGlvbkZhY3RvcnkuamF2YQ==)
 | `100.00% <100.00%> (ø)` | `8.00 <1.00> (+1.00)` | |
   | ... and [1 
more](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421/diff?src=pr=tree-more)
 | |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=footer).
 Last update 
[e837a73...5f7ee96](https://codecov.io/gh/apache/incubator-dolphinscheduler/pull/2421?src=pr=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread

2020-06-28 Thread GitBox


wa-ooo commented on issue #3065:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650893544


   用户管理中可以对资源赋权,如果用户选择了其他租户运行任务就会报错
   ==
   Resources can be weighted in user management and an error will be reported 
if the user selects another tenant to run the task



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread

2020-06-28 Thread GitBox


wa-ooo commented on issue #3065:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650893003


   那为什么要在工作流中使用选择租户而不是用户绑定的租户。既然可以选择那么可以认为用户和租户是1-N的关系



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread

2020-06-28 Thread GitBox


wa-ooo commented on issue #3065:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650892952


   > Yes, the tenant running the workflow needs to be the same as the tenant 
who created the resource file
   
   Then why use tenant selection in the workflow instead of tenant user 
binding. Now that you have a choice you can think of the relationship between 
the user and the tenant as 1-n



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2924: In the case of multiple network cards, a valid host is returned

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #2924:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-650891547


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 [1 Security 
Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [4 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
 [64.1% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2924: In the case of multiple network cards, a valid host is returned

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #2924:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-650726773


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 [1 Security 
Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [4 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
 [64.1% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2884: batch copy or move process #2753

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #2884:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2884#issuecomment-650881931


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL)
 [4 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list)
 [70.7% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list)
 [0.4% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2884: batch copy or move process #2753

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #2884:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2884#issuecomment-650679955


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL)
 [4 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2884=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list)
 [70.7% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list)
 [0.4% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2884=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] break60 commented on pull request #3068: Select and drag dag

2020-06-28 Thread GitBox


break60 commented on pull request #3068:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3068#issuecomment-650873371


   Please don't change the code style of dag.vue page, otherwise I don't know 
what you changed



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] adadfa2 commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


adadfa2 commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650872543


   > > > If using 1.2.1, use 1.2.1-release version
   > > > 
https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   > > > 
![image](https://user-images.githubusercontent.com/39816903/85966772-53a90a00-b9f3-11ea-9d7c-d1e7d5b6273f.png)
   > > 
   > > 
   > > 1.2.1-release version is ok ,But I see that the 1.3 tag still has the 
same problem 
==》https://github.com/apache/incubator-dolphinscheduler/blob/1.3.0/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   > 
   > Hi,
   > Because we move the dependent task to master server, you can check this 
commit [1].
   > 
   > 
[1][4946e88](https://github.com/apache/incubator-dolphinscheduler/commit/4946e88872ef943b5d0a739f213831daca3facd8)
   
   Oh, thanks, we tested the latest version and 1.2.1-release version



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] adadfa2 closed issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


adadfa2 closed issue #3067:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] whitelowrie closed issue #3070: [BUG] have not enough thread when I just run one workflow

2020-06-28 Thread GitBox


whitelowrie closed issue #3070:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3070


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


yangyichao-mango commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650871614


   > > If using 1.2.1, use 1.2.1-release version
   > > 
https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   > > 
![image](https://user-images.githubusercontent.com/39816903/85966772-53a90a00-b9f3-11ea-9d7c-d1e7d5b6273f.png)
   > 
   > 1.2.1-release version is ok ,But I see that the 1.3 tag still has the same 
problem 
==》https://github.com/apache/incubator-dolphinscheduler/blob/1.3.0/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   
   Hi,
   Because we move the dependent task to master server, you can check this 
commit [1].
   
   
[1]https://github.com/apache/incubator-dolphinscheduler/commit/4946e88872ef943b5d0a739f213831daca3facd8



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] frankYu001 commented on issue #3071: [Feature]

2020-06-28 Thread GitBox


frankYu001 commented on issue #3071:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3071#issuecomment-650871676


   
在一个流中多于20个任务节点时,查询指定节点就比较困难,所以建议添加一个查询指定节点的功能,从使用场景上讲,一个流中task数量多是一般情况,有时候我们也确实需要定位到某个指定的task
 node



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] frankYu001 opened a new issue #3071: [Feature]

2020-06-28 Thread GitBox


frankYu001 opened a new issue #3071:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3071


   when there are 20+ tasks in the workflow, we can not find the specified task 
easily. so I recommend add an function which can search the specified task 
,like  locate the task node or show task list ,something etc. That is a usual 
case 20+ tasks in one 
   flow and we sometime really need to locate the specified task.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] adadfa2 commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


adadfa2 commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650870811


   > If using 1.2.1, use 1.2.1-release version
   > 
   > 
https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   > 
   > 
![image](https://user-images.githubusercontent.com/39816903/85966772-53a90a00-b9f3-11ea-9d7c-d1e7d5b6273f.png)
   
1.2.1-release version is ok ,But I see that the 1.3 tag still has the same 
problem 
==》https://github.com/apache/incubator-dolphinscheduler/blob/1.3.0/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


BoYiZhang commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650870559


   now dev branch 
dependent and conditions  has moved to master server 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3027: replace CollectionUtils deprecated method

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #3027:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-650726815


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [0 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list)
 No Coverage information  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3027: replace CollectionUtils deprecated method

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #3027:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-650869170


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [0 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list)
 No Coverage information  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


BoYiZhang commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650868929


   If using 1.2.1, use 1.2.1-release version
   
   
https://github.com/apache/incubator-dolphinscheduler/blob/1.2.1-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   
   
![image](https://user-images.githubusercontent.com/39816903/85966772-53a90a00-b9f3-11ea-9d7c-d1e7d5b6273f.png)
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] whitelowrie opened a new issue #3070: [BUG] have not enough thread when I just run one workflow

2020-06-28 Thread GitBox


whitelowrie opened a new issue #3070:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3070


   1. when I'm running a workflow that contrain  three flume task,I start other 
workflow,It stay in "waiting for thread"
   
![image](https://user-images.githubusercontent.com/13913085/85966119-5d317280-b9f1-11ea-896a-0e856c9a80be.png)
   
   2. I check the linux Server, I found a lot of threads running by the 
MasterServer  
   
![image](https://user-images.githubusercontent.com/13913085/85966131-67ec0780-b9f1-11ea-95b8-0bf95e531b63.png)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] adadfa2 commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.1-SNAPSHOT

2020-06-28 Thread GitBox


adadfa2 commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650863797


   In version 1.2.1, I got it wrong
   
   
   Remove the version submitted by DEPENDENT here
   ==》
   
   
https://github.com/apache/incubator-dolphinscheduler/commit/7f94122f6eb201375b11e4e681849a66e6c572e4#diff-b75d01d2ea0e1cbee19329bfd4f9d78a



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] wacr2008 commented on issue #249: Lineage data kinship(Lineage数据血缘关系)

2020-06-28 Thread GitBox


wacr2008 commented on issue #249:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/249#issuecomment-650857342


   +1



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.0

2020-06-28 Thread GitBox


BoYiZhang commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650855803


   Your code version is wrong 
   
   version: 1.2.0
   
   
![image](https://user-images.githubusercontent.com/39816903/85964044-c3ff5d80-b9ea-11ea-82f6-685114b70116.png)
   
   
   
   
https://github.com/apache/incubator-dolphinscheduler/blob/1.2.0-release/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] BoYiZhang closed issue #3005: [Feature] DataX configures multiple readers and writers through web pages

2020-06-28 Thread GitBox


BoYiZhang closed issue #3005:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3005


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] BoYiZhang commented on issue #3059: [BUG] Workflow definition display exception

2020-06-28 Thread GitBox


BoYiZhang commented on issue #3059:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3059#issuecomment-650854139


   What should I do to avoid it



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] feiyalun commented on issue #3062: It is recommended to modify some of the 1.3.0 table field types

2020-06-28 Thread GitBox


feiyalun commented on issue #3062:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3062#issuecomment-650851171


   It will definitely be dismantled in the future. At present, I want to use it 
for overall testing. If it can run, subtraction will be done in the future.I'd 
love to, but I can't make it
   
   
   --原始邮件--
   发件人:"Yichao Yang"

[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3069: fix single yarn get application status failed

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #3069:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650765303


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [0 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
 [61.5% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3069: fix single yarn get application status failed

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #3069:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754403


   SonarCloud Quality Gate failed.
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [1 Code 
Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
 [64.3% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 13:59:27 UTC 2020 0c41f0007df0eaffadbcfe52553297f9070994fd

2020-06-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 1677c3e  Automated deployment: Sun Jun 28 13:59:27 UTC 2020 
0c41f0007df0eaffadbcfe52553297f9070994fd
1677c3e is described below

commit 1677c3ef00578498b0b5621a8abe4f5db287cbef
Author: lenboo 
AuthorDate: Sun Jun 28 13:59:28 2020 +

Automated deployment: Sun Jun 28 13:59:27 UTC 2020 
0c41f0007df0eaffadbcfe52553297f9070994fd
---
 en-us/docs/release/download.html | 12 
 en-us/docs/release/download.json |  2 +-
 2 files changed, 1 insertion(+), 13 deletions(-)

diff --git a/en-us/docs/release/download.html b/en-us/docs/release/download.html
index ed7667a..842eed2 100644
--- a/en-us/docs/release/download.html
+++ b/en-us/docs/release/download.html
@@ -27,18 +27,6 @@
 
 
 
-Jun. 28th, 2020
-1.3.0
-Source code
-https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip;>[src]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc;>[asc]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512;>[sha512]
-
-
-
-
-Binary Distribution
-https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz;>[tar]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc;>[asc]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512;
 [...]
-
-
 Feb. 24th, 2020
 1.2.1
 Source code
diff --git a/en-us/docs/release/download.json b/en-us/docs/release/download.json
index b62a7c2..da08911 100644
--- a/en-us/docs/release/download.json
+++ b/en-us/docs/release/download.json
@@ -1,6 +1,6 @@
 {
   "filename": "download.md",
-  "__html": "Download the DolphinScheduler releases\nUse the links 
below to download the Apache DolphinScheduler from one of our 
mirrors.\nOnly source code releases are official Apache 
releases: Windows and Linux binary distributions are just for end user 
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\nDownload the DolphinScheduler releases\nUse the links 
below to download the Apache DolphinScheduler from one of our 
mirrors.\nOnly source code releases are official Apache 
releases: Windows and Linux binary distributions are just for end user 
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\n

[incubator-dolphinscheduler-website] branch master updated: revert 130 download (#141)

2020-06-28 Thread leonbao
This is an automated email from the ASF dual-hosted git repository.

leonbao pushed a commit to branch master
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/master by this push:
 new 0c41f00  revert 130 download (#141)
0c41f00 is described below

commit 0c41f0007df0eaffadbcfe52553297f9070994fd
Author: bao liang <29528966+len...@users.noreply.github.com>
AuthorDate: Sun Jun 28 21:56:35 2020 +0800

revert 130 download (#141)

* test

* test

* change structure of documents

* add how to become a committer

* update documents

* update documents

* update

* update

* update

* update chinese to english

* add 1.3.0 download links

* revert

* revert

Co-authored-by: baoliang 
---
 docs/en-us/release/download.md | 2 --
 1 file changed, 2 deletions(-)

diff --git a/docs/en-us/release/download.md b/docs/en-us/release/download.md
index 76dc8cc..35ac840 100644
--- a/docs/en-us/release/download.md
+++ b/docs/en-us/release/download.md
@@ -8,8 +8,6 @@ Use the links below to download the Apache DolphinScheduler 
from one of our mirr
 ## DolphinScheduler
 | Date | Version| | Downloads |
 |:---:|:--:|:--:|:--:|
-| Jun. 28th, 2020 | 1.3.0 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512)|
-| | | Binary Distribution| 
[[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512)|
 | Feb. 24th, 2020 | 1.2.1 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.sha512)|
 | | | Binary Distribution| 
[[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.sha512)|
 | Feb. 2th, 2020 | 1.2.0 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.sha512)|



[GitHub] [incubator-dolphinscheduler-website] lenboo opened a new pull request #141: revert 130 download

2020-06-28 Thread GitBox


lenboo opened a new pull request #141:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/141


   revert 130 download



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler-website] lenboo merged pull request #141: revert 130 download

2020-06-28 Thread GitBox


lenboo merged pull request #141:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/141


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3069: fix single yarn get application status failed

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #3069:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754403


   SonarCloud Quality Gate failed.
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [1 Code 
Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
 [64.3% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3069: fix single yarn get application status failed

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #3069:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754058


   SonarCloud Quality Gate failed.
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [1 Code 
Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
 [64.3% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3069: fix single yarn get application status failed

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #3069:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3069#issuecomment-650754058


   SonarCloud Quality Gate failed.
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
 [1 Code 
Smell](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3069=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
 [64.3% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3069=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3068: Select and drag dag

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #3068:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3068#issuecomment-650753791


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=CODE_SMELL)
 [0 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3068=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3068=coverage=list)
 No Coverage information  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3068=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3068=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] Eights-Li opened a new pull request #3069: fix single yarn get application status failed

2020-06-28 Thread GitBox


Eights-Li opened a new pull request #3069:
URL: https://github.com/apache/incubator-dolphinscheduler/pull/3069


   ## What is the purpose of the pull request
   
   *fix single yarn get application status failed*
   deploy dolphin scheduler in single yarn hadoop cluster, 
   exec a yarn job will lead npe when get the yarn app status 
   
   ## Brief change log
   
 - *Modify HadoopUtils*
   
   ## Verify this pull request
   
   This pull request is already covered by existing tests, such as:
   *dolphinscheduler/common/utils/HadoopUtilsTest.java*
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] satcblue opened a new pull request #3068: Select and drag dag

2020-06-28 Thread GitBox


satcblue opened a new pull request #3068:
URL: https://github.com/apache/incubator-dolphinscheduler/pull/3068


   ## Support to multi drag task 
   
   ## What is the purpose of the pull request
   
   - Convenient for users to drag and drop, when user use the dag, he should 
drag one by one. Now, he can select one or more by pressing the key of 'ctrl'.
   ## Brief change log
 - Add multiDrag.js 
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3046: [Feature] Workflow version control

2020-06-28 Thread GitBox


yangyichao-mango commented on issue #3046:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3046#issuecomment-650749192


   > @yangyichao-mango any release plan?
   
   Hi,
   I'm working on it, and if you're interested in this, you can follow the 
mailing list[1].
   
   [1] 
https://lists.apache.org/thread.html/r4db87136679dc9badf173292e94c10c5097c8f19547d8ac4aa5f5990%40%3Cdev.dolphinscheduler.apache.org%3E



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3061: [QUESTION] task submit succuess but can't continue

2020-06-28 Thread GitBox


yangyichao-mango commented on issue #3061:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3061#issuecomment-650747714


   Hi,
   Can you describe which version and how to reproduce this.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3062: It is recommended to modify some of the 1.3.0 table field types

2020-06-28 Thread GitBox


yangyichao-mango commented on issue #3062:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3062#issuecomment-650747150


   > 部分字段长度类型不够,我建议修改一下,因为工作流中一旦有500+task,维护表关系就会报错
   
   Hi~
   Will 500+ task appear in a workflow in your current scenario?
   In my opinion, if one workflow has 500+ task, it should be split to small 
task first, because it will be clearer and easier to manage.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] yangyichao-mango commented on issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.0

2020-06-28 Thread GitBox


yangyichao-mango commented on issue #3067:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3067#issuecomment-650745108


   Hi,
   What you mean is in the version 1.2.0 or bigger than version 1.2.0
   Can you describe the detail how to reproduce this bug?
   Thx a lot.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #3060: Abnormal situation of cluster time display

2020-06-28 Thread GitBox


samz406 commented on issue #3060:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3060#issuecomment-650743368


   Please change the title to English and describe your question follow the 
question line



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #3050: [QUESTION] question title 监控中心那边worker和marter那边的心跳时间比北京时间快5小时,检查了服务器时间,时区,数据库时间都是正确的,请问这个问题要怎么处理?

2020-06-28 Thread GitBox


samz406 commented on issue #3050:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3050#issuecomment-650743159


   same issue #3060,i will close



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] samz406 closed issue #3050: [QUESTION] question title 监控中心那边worker和marter那边的心跳时间比北京时间快5小时,检查了服务器时间,时区,数据库时间都是正确的,请问这个问题要怎么处理?

2020-06-28 Thread GitBox


samz406 closed issue #3050:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3050


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #3060: Abnormal situation of cluster time display

2020-06-28 Thread GitBox


samz406 commented on issue #3060:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3060#issuecomment-650742320


   The worker master reports the heartbeat to obtain the current server time, 
so you need to check the time of the two servers 49,41
   worker master上报心跳是取得当前服务器时间,所以需要你检查下49,41两台服务器时间



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] jxzdoing commented on issue #3066: [QUESTION] Can't set dependency check

2020-06-28 Thread GitBox


jxzdoing commented on issue #3066:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650731219


   > Which version?
   > Can you describe the steps to reproduce
   
   Hi,
  The DS version is:1.2.1



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 10:30:51 UTC 2020 d8ed86840727990ba69d76a8f3b1febe0015ffc4

2020-06-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 594814e  Automated deployment: Sun Jun 28 10:30:51 UTC 2020 
d8ed86840727990ba69d76a8f3b1febe0015ffc4
594814e is described below

commit 594814e1b8f35f2ed58ad35681fb22b0193b787b
Author: lgcareer 
AuthorDate: Sun Jun 28 10:30:52 2020 +

Automated deployment: Sun Jun 28 10:30:51 UTC 2020 
d8ed86840727990ba69d76a8f3b1febe0015ffc4
---
 build/blog.js  |   2 +-
 build/blogDetail.js|   2 +-
 build/community.js |   2 +-
 build/documentation.js |   4 +-
 build/home.js  |   2 +-
 img/architecture-1.3.0.jpg | Bin 0 -> 392697 bytes
 img/process-start-flow-1.3.0.png   | Bin 0 -> 224425 bytes
 zh-cn/docs/1.3.0/user_doc/architecture-design.html | 353 +
 zh-cn/docs/1.3.0/user_doc/architecture-design.json |   6 +
 9 files changed, 365 insertions(+), 6 deletions(-)

diff --git a/build/blog.js b/build/blog.js
index a828b7a..48c967a 100644
--- a/build/blog.js
+++ b/build/blog.js
@@ -10,7 +10,7 @@ object-assign
 (c) Sindre Sorhus
 @license MIT
 */
-var 
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
 e=new 
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
 
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
 t[e]}).join(""))return!1;var 
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
 [...]
+var 
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
 e=new 
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
 
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
 t[e]}).join(""))return!1;var 
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
 [...]
 //! moment.js locale configuration
 var t=function(e){return 
0===e?0:1===e?1:2===e?2:e%100>=3&%100<=10?3:e%100>=11?4:5},n={s:["أقل من 
ثانية","ثانية واحدة",["ثانيتان","ثانيتين"],"%d ثوان","%d ثانية","%d 
ثانية"],m:["أقل من دقيقة","دقيقة واحدة",["دقيقتان","دقيقتين"],"%d دقائق","%d 
دقيقة","%d دقيقة"],h:["أقل من ساعة","ساعة واحدة",["ساعتان","ساعتين"],"%d 
ساعات","%d ساعة","%d ساعة"],d:["أقل من يوم","يوم واحد",["يومان","يومين"],"%d 
أيام","%d يومًا","%d يوم"],M:["أقل من شهر","شهر واحد",["شهران","شهرين"],"%d 
أشهر","%d شهرا","%d ش [...]
 //! moment.js locale configuration
diff --git a/build/blogDetail.js b/build/blogDetail.js
index d2b6167..7ea85c1 100644
--- a/build/blogDetail.js
+++ b/build/blogDetail.js
@@ -10,7 +10,7 @@ object-assign
 (c) Sindre Sorhus
 @license MIT
 */
-var 
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
 e=new 
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
 
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
 t[e]}).join(""))return!1;var 
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
 [...]
+var 
o=Object.getOwnPropertySymbols,i=Object.prototype.hasOwnProperty,a=Object.prototype.propertyIsEnumerable;e.exports=function(){try{if(!Object.assign)return!1;var
 e=new 
String("abc");if(e[5]="de","5"===Object.getOwnPropertyNames(e)[0])return!1;for(var
 
t={},n=0;n<10;n++)t["_"+String.fromCharCode(n)]=n;if("0123456789"!==Object.getOwnPropertyNames(t).map(function(e){return
 t[e]}).join(""))return!1;var 
r={};return"abcdefghijklmnopqrst".split("").forEach(function(e){r[e]=e}),"abcdefghijklmn
 [...]
 //! moment.js locale configuration
 var t=function(e){return 
0===e?0:1===e?1:2===e?2:e%100>=3&%100<=10?3:e%100>=11?4:5},n={s:["أقل من 
ثانية","ثانية واحدة",["ثانيتان","ثانيتين"],"%d ثوان","%d ثانية","%d 
ثانية"],m:["أقل من دقيقة","دقيقة واحدة",["دقيقتان","دقيقتين"],"%d دقائق","%d 
دقيقة","%d دقيقة"],h:["أقل من ساعة","ساعة واحدة",["ساعتان","ساعتين"],"%d 
ساعات","%d ساعة","%d ساعة"],d:["أقل من يوم","يوم واحد",["يومان","يومين"],"%d 
أيام","%d يومًا","%d يوم"],M:["أقل من شهر","شهر واحد",["شهران","شهرين"],"%d 
أشهر","%d شهرا","%d ش [...]
 //! moment.js locale configuration
diff --git a/build/community.js b/build/community.js
index 4659e08..b4c3bb3 100644
--- a/build/community.js
+++ b/build/community.js
@@ -10,7 

[GitHub] [incubator-dolphinscheduler-website] lgcareer merged pull request #140: add version 1.3.0 of architecture design

2020-06-28 Thread GitBox


lgcareer merged pull request #140:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/140


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch master updated: add version 1.3.0 of architecture design

2020-06-28 Thread lgcareer
This is an automated email from the ASF dual-hosted git repository.

lgcareer pushed a commit to branch master
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/master by this push:
 new 9ae7676  add version 1.3.0 of architecture design
 new d8ed868  Merge pull request #140 from lgcareer/master-1.3.0-doc
9ae7676 is described below

commit 9ae7676938d939996905661d3b6419f67138a996
Author: lgcareer <18610854...@163.com>
AuthorDate: Sun Jun 28 17:56:42 2020 +0800

add version 1.3.0 of architecture design
---
 docs/zh-cn/1.3.0/user_doc/architecture-design.md | 331 +++
 img/architecture-1.3.0.jpg   | Bin 0 -> 392697 bytes
 img/process-start-flow-1.3.0.png | Bin 0 -> 224425 bytes
 site_config/docs1-3-0.js |   6 +-
 site_config/site.js  |   2 +-
 5 files changed, 335 insertions(+), 4 deletions(-)

diff --git a/docs/zh-cn/1.3.0/user_doc/architecture-design.md 
b/docs/zh-cn/1.3.0/user_doc/architecture-design.md
new file mode 100644
index 000..ec5c28a
--- /dev/null
+++ b/docs/zh-cn/1.3.0/user_doc/architecture-design.md
@@ -0,0 +1,331 @@
+## 系统架构设计
+在对调度系统架构说明之前,我们先来认识一下调度系统常用的名词
+
+### 1.名词解释
+**DAG:** 全称Directed Acyclic 
Graph,简称DAG。工作流中的Task任务以有向无环图的形式组装起来,从入度为零的节点进行拓扑遍历,直到无后继节点为止。举例如下图:
+
+
+  
+  
+dag示例
+  
+
+
+**流程定义**:通过拖拽任务节点并建立任务节点的关联所形成的可视化**DAG**
+
+**流程实例**:流程实例是流程定义的实例化,可以通过手动启动或定时调度生成,流程定义每运行一次,产生一个流程实例
+
+**任务实例**:任务实例是流程定义中任务节点的实例化,标识着具体的任务执行状态
+
+**任务类型**: 
目前支持有SHELL、SQL、SUB_PROCESS(子流程)、PROCEDURE、MR、SPARK、PYTHON、DEPENDENT(依赖)、,同时计划支持动态插件扩展,注意:其中子
 **SUB_PROCESS**  也是一个单独的流程定义,是可以单独启动执行的
+
+**调度方式:** 
系统支持基于cron表达式的定时调度和手动调度。命令类型支持:启动工作流、从当前节点开始执行、恢复被容错的工作流、恢复暂停流程、从失败节点开始执行、补数、定时、重跑、暂停、停止、恢复等待线程。其中
 **恢复被容错的工作流** 和 **恢复等待线程** 两种命令类型是由调度内部控制使用,外部无法调用
+
+**定时调度**:系统采用 **quartz** 分布式调度器,并同时支持cron表达式可视化的生成
+
+**依赖**:系统不单单支持 **DAG** 简单的前驱和后继节点之间的依赖,同时还提供**任务依赖**节点,支持**流程间的自定义任务依赖**
+
+**优先级** :支持流程实例和任务实例的优先级,如果流程实例和任务实例的优先级不设置,则默认是先进先出
+
+**邮件告警**:支持 **SQL任务** 查询结果邮件发送,流程实例运行结果邮件告警及容错告警通知
+
+**失败策略**:对于并行运行的任务,如果有任务失败,提供两种失败策略处理方式,**继续**是指不管并行运行任务的状态,直到流程失败结束。**结束**是指一旦发现失败任务,则同时Kill掉正在运行的并行任务,流程失败结束
+
+**补数**:补历史数据,支持**区间并行和串行**两种补数方式
+
+### 2.系统架构
+
+ 2.1 系统架构图
+
+  
+  
+系统架构图
+  
+
+
+ 2.2 启动流程活动图
+
+  
+  
+启动流程活动图
+  
+
+
+ 2.3 架构说明
+
+* **MasterServer** 
+
+MasterServer采用分布式无中心设计理念,MasterServer主要负责 DAG 
任务切分、任务提交监控,并同时监听其它MasterServer和WorkerServer的健康状态。
+MasterServer服务启动时向Zookeeper注册临时节点,通过监听Zookeeper临时节点变化来进行容错处理。
+MasterServer基于netty提供监听服务。
+
+# 该服务内主要包含:
+
+- **Distributed 
Quartz**分布式调度组件,主要负责定时任务的启停操作,当quartz调起任务后,Master内部会有线程池具体负责处理任务的后续操作
+
+- **MasterSchedulerThread**是一个扫描线程,定时扫描数据库中的 **command** 
表,根据不同的**命令类型**进行不同的业务操作
+
+- **MasterExecThread**主要是负责DAG任务切分、任务提交监控、各种不同命令类型的逻辑处理
+
+- **MasterTaskExecThread**主要负责任务的持久化
+
+* **WorkerServer** 
+
+ WorkerServer也采用分布式无中心设计理念,WorkerServer主要负责任务的执行和提供日志服务。
+ WorkerServer服务启动时向Zookeeper注册临时节点,并维持心跳。
+ Server基于netty提供监听服务。Worker
+ # 该服务包含:
+ - **FetchTaskThread**主要负责不断从**Task 
Queue**中领取任务,并根据不同任务类型调用**TaskScheduleThread**对应执行器。
+
+ - **LoggerServer**是一个RPC服务,提供日志分片查看、刷新和下载等功能
+
+* **ZooKeeper** 
+
+
ZooKeeper服务,系统中的MasterServer和WorkerServer节点都通过ZooKeeper来进行集群管理和容错。另外系统还基于ZooKeeper进行事件监听和分布式锁。
+我们也曾经基于Redis实现过队列,不过我们希望DolphinScheduler依赖到的组件尽量地少,所以最后还是去掉了Redis实现。
+
+* **Task Queue** 
+
+
提供任务队列的操作,目前队列也是基于Zookeeper来实现。由于队列中存的信息较少,不必担心队列里数据过多的情况,实际上我们压测过百万级数据存队列,对系统稳定性和性能没影响。
+
+* **Alert** 
+
+
提供告警相关接口,接口主要包括**告警**两种类型的告警数据的存储、查询和通知功能。其中通知功能又有**邮件通知**和**SNMP(暂未实现)**两种。
+
+* **API** 
+
+API接口层,主要负责处理前端UI层的请求。该服务统一提供RESTful api向外部提供请求服务。
+接口包括工作流的创建、定义、查询、修改、发布、下线、手工启动、停止、暂停、恢复、从该节点开始执行等等。
+
+* **UI** 
+
+系统的前端页面,提供系统的各种可视化操作界面,详见系统使用手册部分。
+
+ 2.3 架构设计思想
+
+# 一、去中心化vs中心化 
+
+## 中心化思想
+
+中心化的设计理念比较简单,分布式集群中的节点按照角色分工,大体上分为两种角色:
+
+   https://analysys.github.io/easyscheduler_docs_cn/images/master_slave.png; 
alt="master-slave角色"  width="50%" />
+ 
+
+- Master的角色主要负责任务分发并监督Slave的健康状态,可以动态的将任务均衡到Slave上,以致Slave节点不至于“忙死”或”闲死”的状态。
+- Worker的角色主要负责任务的执行工作并维护和Master的心跳,以便Master可以分配任务给Slave。
+
+
+
+中心化思想设计存在的问题:
+
+- 
一旦Master出现了问题,则群龙无首,整个集群就会崩溃。为了解决这个问题,大多数Master/Slave架构模式都采用了主备Master的设计方案,可以是热备或者冷备,也可以是自动切换或手动切换,而且越来越多的新系统都开始具备自动选举切换Master的能力,以提升系统的可用性。
+- 
另外一个问题是如果Scheduler在Master上,虽然可以支持一个DAG中不同的任务运行在不同的机器上,但是会产生Master的过负载。如果Scheduler在Slave上,则一个DAG中所有的任务都只能在某一台机器上进行作业提交,则并行任务比较多的时候,Slave的压力可能会比较大。
+
+
+
+## 去中心化
+ https://analysys.github.io/easyscheduler_docs_cn/images/decentralization.png;
 alt="去中心化"  width="50%" />
+ 
+
+- 
在去中心化设计里,通常没有Master/Slave的概念,所有的角色都是一样的,地位是平等的,全球互联网就是一个典型的去中心化的分布式系统,联网的任意节点设备down机,都只会影响很小范围的功能。
+- 去中心化设计的核心设计在于整个分布式系统中不存在一个区别于其他节点的”管理者”,因此不存在单点故障问题。但由于不存在” 
管理者”节点所以每个节点都需要跟其他节点通信才得到必须要的机器信息,而分布式系统通信的不可靠性,则大大增加了上述功能的实现难度。
+- 

[GitHub] [incubator-dolphinscheduler] jxzdoing commented on issue #3066: [QUESTION] Can't set dependency check

2020-06-28 Thread GitBox


jxzdoing commented on issue #3066:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650730626


   > > HI everyone,
   > > we have a lot of workflow in one project,those workflow was created by 
time order。when i need to set dependency check in
   > > a workflow(it depends on a node in another workflow ),It's really 
strange,in the second select box,I can select the destination workflow,but in 
the third select box,the nodes display are not belong to the workflow which was 
selected in the second select box, its' belong to the workflow which was 
created last time,It's anyone has the same problem?
   > > the second select box:
   > > 
![image](https://user-images.githubusercontent.com/16585537/85942844-92d94b80-b95e-11ea-827e-a9185d648c70.png)
   > > the third select box:
   > > 
![image](https://user-images.githubusercontent.com/16585537/85943089-50187300-b960-11ea-953c-de1d15afa76f.png)
   > 
   > sometime the dependency does not work!
   
   did you mean It's a bug for DS?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler-website] lgcareer opened a new pull request #140: add version 1.3.0 of architecture design

2020-06-28 Thread GitBox


lgcareer opened a new pull request #140:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/140


   add version 1.3.0 of architecture design



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler-website] break60 opened a new pull request #139: Migrating the developer guide below the developer

2020-06-28 Thread GitBox


break60 opened a new pull request #139:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/139


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2924: In the case of multiple network cards, a valid host is returned

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #2924:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-650726773


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 [1 Security 
Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [4 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
 [64.1% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3027: replace CollectionUtils deprecated method

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #3027:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-649978022


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [0 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list)
 No Coverage information  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2924: In the case of multiple network cards, a valid host is returned

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #2924:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2924#issuecomment-649978456


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 [1 Security 
Hotspot](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
 [4 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2924=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
 [64.1% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2924=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3027: replace CollectionUtils deprecated method

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #3027:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/3027#issuecomment-650726815


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
 [0 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3027=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=coverage=list)
 No Coverage information  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=3027=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler] branch dev updated: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925) (#2965)

2020-06-28 Thread lidongdai
This is an automated email from the ASF dual-hosted git repository.

lidongdai pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler.git


The following commit(s) were added to refs/heads/dev by this push:
 new 38e4853  [Feature-2925][server] Init TaskLogger in 
TaskExecuteProcessor (#2925) (#2965)
38e4853 is described below

commit 38e485373de9a7301a19f57cb53dbf4cb6744696
Author: Yichao Yang <1048262...@qq.com>
AuthorDate: Sun Jun 28 17:43:13 2020 +0800

[Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925) 
(#2965)

* [Feature-2925][common] Add exitVal judge in OSUtils.exeCmd (#2925)

* optimize the logger utils
---
 .../common/shell/AbstractShell.java|  40 +---
 .../dolphinscheduler/common/utils/FileUtils.java   |  60 +---
 .../dolphinscheduler/common/utils/LoggerUtils.java |  27 +-
 .../dolphinscheduler/common/utils/OSUtils.java | 103 -
 .../dolphinscheduler/common/utils/OSUtilsTest.java |   6 +-
 .../dolphinscheduler/server/log/TaskLogFilter.java |   9 +-
 .../worker/processor/TaskExecuteProcessor.java |  42 ++---
 .../server/worker/runner/TaskExecuteThread.java|  36 +++
 8 files changed, 220 insertions(+), 103 deletions(-)

diff --git 
a/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
 
b/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
index f846b19..aafdb86 100644
--- 
a/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
+++ 
b/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/shell/AbstractShell.java
@@ -16,9 +16,6 @@
  */
 package org.apache.dolphinscheduler.common.shell;
 
-import org.slf4j.Logger;
-import org.slf4j.LoggerFactory;
-
 import java.io.BufferedReader;
 import java.io.File;
 import java.io.IOException;
@@ -30,6 +27,9 @@ import java.util.TimerTask;
 import java.util.concurrent.ConcurrentHashMap;
 import java.util.concurrent.atomic.AtomicBoolean;
 
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
 
 /** 
  * A base class for running a Unix command.
@@ -128,7 +128,7 @@ public abstract class AbstractShell {
   /**
* Run a command   actual work
*/
-  private void runCommand() throws IOException { 
+  private void runCommand() throws IOException {
 ProcessBuilder builder = new ProcessBuilder(getExecString());
 Timer timeOutTimer = null;
 ShellTimeoutTimerTask timeoutTimerTask = null;
@@ -153,11 +153,11 @@ public abstract class AbstractShell {
   timeOutTimer.schedule(timeoutTimerTask, timeOutInterval);
 }
 final BufferedReader errReader = 
-new BufferedReader(new InputStreamReader(process
- .getErrorStream()));
-BufferedReader inReader = 
-new BufferedReader(new InputStreamReader(process
- .getInputStream()));
+new BufferedReader(
+new InputStreamReader(process.getErrorStream()));
+BufferedReader inReader =
+new BufferedReader(
+new InputStreamReader(process.getInputStream()));
 final StringBuilder errMsg = new StringBuilder();
 
 // read error and input streams as this would free up the buffers
@@ -177,23 +177,35 @@ public abstract class AbstractShell {
 }
   }
 };
+Thread inThread = new Thread() {
+  @Override
+  public void run() {
+try {
+  parseExecResult(inReader);
+} catch (IOException ioe) {
+  logger.warn("Error reading the in stream", ioe);
+}
+super.run();
+  }
+};
 try {
   errThread.start();
+  inThread.start();
 } catch (IllegalStateException ise) { }
 try {
   // parse the output
-  parseExecResult(inReader);
-  exitCode  = process.waitFor();
+  exitCode = process.waitFor();
   try {
-// make sure that the error thread exits
+// make sure that the error and in thread exits
 errThread.join();
+inThread.join();
   } catch (InterruptedException ie) {
-logger.warn("Interrupted while reading the error stream", ie);
+logger.warn("Interrupted while reading the error and in stream", ie);
   }
   completed.set(true);
   //the timeout thread handling
   //taken care in finally block
-  if (exitCode != 0) {
+  if (exitCode != 0 || errMsg.length() > 0) {
 throw new ExitCodeException(exitCode, errMsg.toString());
   }
 } catch (InterruptedException ie) {
diff --git 
a/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/FileUtils.java
 
b/dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils/FileUtils.java
index bae8f7f..de3d429 100644
--- 

[GitHub] [incubator-dolphinscheduler] adadfa2 opened a new issue #3067: [BUG] DEPENDENT node type is not supported since version 1.2.0

2020-06-28 Thread GitBox


adadfa2 opened a new issue #3067:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3067


   version 【1.2.0 】
   
   When choosing to use the dependent node task, an error is reported during 
execution 
   `[ERROR] 2020-06-28 
15:27:22.118-[taskAppId=TASK-341-240188-431977]:[75]-unsupport task type: 
DEPENDENT`
   
   See below
   
   https://user-images.githubusercontent.com/38177161/85943967-295d3b00-b966-11ea-8481-ed904fb7bf86.png;>
   
   code show as below
   
   https://user-images.githubusercontent.com/38177161/85944027-7fca7980-b966-11ea-8d13-e60f4cd3d5c0.png;>
   
   
==》https://github.com/apache/incubator-dolphinscheduler/blob/4946e88872ef943b5d0a739f213831daca3facd8/dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/worker/task/TaskManager.java
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] dailidong closed issue #2925: [BUG] There is no exitVal judge in OSUtils.exeCmd function

2020-06-28 Thread GitBox


dailidong closed issue #2925:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2925


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] dailidong merged pull request #2965: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)

2020-06-28 Thread GitBox


dailidong merged pull request #2965:
URL: https://github.com/apache/incubator-dolphinscheduler/pull/2965


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] dailidong closed issue #3014: [Feature] Init TaskLogger in TaskExecuteProcessor

2020-06-28 Thread GitBox


dailidong closed issue #3014:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3014


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 09:37:55 UTC 2020 088d38aae6daf2f935ed6dc062e60cdb171a7e59

2020-06-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new b0bea0c  Automated deployment: Sun Jun 28 09:37:55 UTC 2020 
088d38aae6daf2f935ed6dc062e60cdb171a7e59
b0bea0c is described below

commit b0bea0ca902dd0b8701452fc97648b6ff5299091
Author: lgcareer 
AuthorDate: Sun Jun 28 09:37:56 2020 +

Automated deployment: Sun Jun 28 09:37:55 UTC 2020 
088d38aae6daf2f935ed6dc062e60cdb171a7e59
---
 zh-cn/docs/1.3.0/user_doc/metadata-1.3.html | 28 +++-
 zh-cn/docs/1.3.0/user_doc/metadata-1.3.json |  2 +-
 zh-cn/docs/release/download.html| 12 
 zh-cn/docs/release/download.json|  2 +-
 4 files changed, 33 insertions(+), 11 deletions(-)

diff --git a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html 
b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
index 876f21f..85b9391 100644
--- a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
+++ b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html
@@ -12,7 +12,7 @@

 
 
-   EnEn
 表概览
 
@@ -249,6 +249,16 @@
 datetime
 更新时间
 
+
+modify_by
+varchar
+修改用户
+
+
+resource_ids
+varchar
+资源id集
+
 
 
 
@@ -408,8 +418,8 @@
 流程实例优先级:0 Highest,1 High,2 Medium,3 Low,4 Lowest
 
 
-worker_group_id
-int
+worker_group
+varchar
 任务指定运行的worker分组
 
 
@@ -541,8 +551,8 @@
 任务实例优先级:0 Highest,1 High,2 Medium,3 Low,4 Lowest
 
 
-worker_group_id
-int
+worker_group
+varchar
 任务指定运行的worker分组
 
 
@@ -614,8 +624,8 @@
 流程实例优先级:0 Highest,1 High,2 Medium,3 Low,4 Lowest
 
 
-worker_group_id
-int
+worker_group
+varchar
 任务指定运行的worker分组
 
 
@@ -712,8 +722,8 @@
 流程实例优先级:0 Highest,1 High,2 Medium,3 Low,4 Lowest
 
 
-worker_group_id
-int
+worker_group
+varchar
 任务指定运行的worker分组
 
 
diff --git a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json 
b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
index 02008e9..c68e78d 100644
--- a/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
+++ b/zh-cn/docs/1.3.0/user_doc/metadata-1.3.json
@@ -1,6 +1,6 @@
 {
   "filename": "metadata-1.3.md",
-  "__html": "Dolphin Scheduler 1.2元数据文档\n\n表概览\n\n\n\n表名\n表信息\n\n\n\n\nt_ds_access_token\n访问ds后端的token\n\n\nt_ds_alert\n告警信息\n\n\nt [...]
+  "__html": "Dolphin Scheduler 1.3元数据文档\n\n表概览\n\n\n\n表名\n表信息\n\n\n\n\nt_ds_access_token\n访问ds后端的token\n\n\nt_ds_alert\n告警信息\n\n\nt [...]
   "link": "/zh-cn/docs/1.3.0/user_doc/metadata-1.3.html",
   "meta": {}
 }
\ No newline at end of file
diff --git a/zh-cn/docs/release/download.html b/zh-cn/docs/release/download.html
index eeb7e4e..1436391 100644
--- a/zh-cn/docs/release/download.html
+++ b/zh-cn/docs/release/download.html
@@ -27,6 +27,18 @@
 
 
 
+Jun. 28th, 2020
+1.3.0
+Source code
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip;>[src]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc;>[asc]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512;>[sha512]
+
+
+
+
+Binary Distribution
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz;>[tar]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc;>[asc]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512;
 [...]
+
+
 Feb. 24th, 2020
 1.2.1
 Source code
diff --git a/zh-cn/docs/release/download.json b/zh-cn/docs/release/download.json
index 8d37dda..1fe6570 100644
--- a/zh-cn/docs/release/download.json
+++ b/zh-cn/docs/release/download.json
@@ -1,6 +1,6 @@
 {
   "filename": "download.md",
-  "__html": "下载DolphinScheduler发布版本\n使用下面的链接,从Apache 
DolphinScheduler的镜像下载。\n只有源码包属于Apache官方发布包,二进制发布包只是为了方便用户使用。\nDolphinScheduler\n\n\n\n日期\n版本\n\n下载\n\n\n\n\nFeb. 24th, 2020\n1.2.1< [...]
+  "__html": "下载DolphinScheduler发布版本\n使用下面的链接,从Apache 
DolphinScheduler的镜像下载。\n只有源码包属于Apache官方发布包,二进制发布包只是为了方便用户使用。\nDolphinScheduler\n\n\n\n日期\n版本\n\n下载\n\n\n\n\nJun. 28th, 2020\n1.3.0< [...]
   "link": "/zh-cn/docs/release/download.html",
   "meta": {}
 }
\ No newline at end of file



[GitHub] [incubator-dolphinscheduler-website] lgcareer opened a new pull request #138: add metadata-1.3 and update download page

2020-06-28 Thread GitBox


lgcareer opened a new pull request #138:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/138


   add metadata-1.3 and update download page



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch master updated: add metadata-1.3 and update download page

2020-06-28 Thread lgcareer
This is an automated email from the ASF dual-hosted git repository.

lgcareer pushed a commit to branch master
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/master by this push:
 new da5467e  add metadata-1.3 and update download page
 new 088d38a  Merge pull request #138 from lgcareer/master-1.3.0-doc
da5467e is described below

commit da5467ed9245acacb722fab15421ec4fd2775d6e
Author: lgcareer <18610854...@163.com>
AuthorDate: Sun Jun 28 17:32:56 2020 +0800

add metadata-1.3 and update download page
---
 docs/zh-cn/1.3.0/user_doc/metadata-1.3.md | 12 +++-
 docs/zh-cn/release/download.md|  2 ++
 2 files changed, 9 insertions(+), 5 deletions(-)

diff --git a/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md 
b/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md
index 09a14ae..e298b48 100644
--- a/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md
+++ b/docs/zh-cn/1.3.0/user_doc/metadata-1.3.md
@@ -1,4 +1,4 @@
-# Dolphin Scheduler 1.2元数据文档
+# Dolphin Scheduler 1.3元数据文档
 
 
 ### 表概览
@@ -75,6 +75,8 @@
 | timeout | int | 超时时间 |
 | tenant_id | int | 租户id |
 | update_time | datetime | 更新时间 |
+| modify_by | varchar | 修改用户 |
+| resource_ids | varchar | 资源id集 |
 
 
  t_ds_process_instance
@@ -109,7 +111,7 @@
 | history_cmd | text | 历史命令,记录所有对流程实例的操作 |
 | dependence_schedule_times | text | 依赖节点的预估时间 |
 | process_instance_priority | int | 流程实例优先级:0 Highest,1 High,2 Medium,3 Low,4 
Lowest |
-| worker_group_id | int | 任务指定运行的worker分组 |
+| worker_group | varchar | 任务指定运行的worker分组 |
 | timeout | int | 超时时间 |
 | tenant_id | int | 租户id |
 
@@ -138,7 +140,7 @@
 | retry_interval | int | 重试间隔 |
 | max_retry_times | int | 最大重试次数 |
 | task_instance_priority | int | 任务实例优先级:0 Highest,1 High,2 Medium,3 Low,4 
Lowest |
-| worker_group_id | int | 任务指定运行的worker分组 |
+| worker_group | varchar | 任务指定运行的worker分组 |
 
 
  t_ds_schedules
@@ -155,7 +157,7 @@
 | warning_type | tinyint | 告警类型:0 不发,1 流程成功发,2 流程失败发,3 成功失败都发 |
 | warning_group_id | int | 告警组id |
 | process_instance_priority | int | 流程实例优先级:0 Highest,1 High,2 Medium,3 Low,4 
Lowest |
-| worker_group_id | int | 任务指定运行的worker分组 |
+| worker_group | varchar | 任务指定运行的worker分组 |
 | create_time | datetime | 创建时间 |
 | update_time | datetime | 更新时间 |
 
@@ -177,7 +179,7 @@
 | dependence | varchar | 依赖字段 |
 | update_time | datetime | 更新时间 |
 | process_instance_priority | int | 流程实例优先级:0 Highest,1 High,2 Medium,3 Low,4 
Lowest |
-| worker_group_id | int | 任务指定运行的worker分组 |
+| worker_group | varchar | 任务指定运行的worker分组 |
 
 
 
diff --git a/docs/zh-cn/release/download.md b/docs/zh-cn/release/download.md
index b0df434..c0b7af0 100644
--- a/docs/zh-cn/release/download.md
+++ b/docs/zh-cn/release/download.md
@@ -7,6 +7,8 @@
 ## DolphinScheduler
 | 日期 | 版本| | 下载 |
 |:---:|:--:|:--:|:--:|
+| Jun. 28th, 2020 | 1.3.0 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512)|
+| | | Binary Distribution| 
[[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512)|
 | Feb. 24th, 2020 | 1.2.1 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.sha512)|
 | | | Binary Distribution| 
[[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.sha512)|
 | Jan. 2th, 2020 | 1.2.0 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.asc)
 

[GitHub] [incubator-dolphinscheduler-website] lgcareer merged pull request #138: add metadata-1.3 and update download page

2020-06-28 Thread GitBox


lgcareer merged pull request #138:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/138


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #3066: [QUESTION] Can't set dependency check

2020-06-28 Thread GitBox


xingchun-chen commented on issue #3066:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650724948


   Which version?
   Can you describe the steps to reproduce



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3066: [QUESTION] Can't set dependency check

2020-06-28 Thread GitBox


super-sponge commented on issue #3066:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3066#issuecomment-650723215


   > HI everyone,
   > we have a lot of workflow in one project,those workflow was created by 
time order。when i need to set dependency check in
   > a workflow(it depends on a node in another workflow ),It's really 
strange,in the second select box,I can select the destination workflow,but in 
the third select box,the nodes display are not belong to the workflow which was 
selected in the second select box, its' belong to the workflow which was 
created last time,It's anyone has the same problem?
   > the second select box:
   > 
![image](https://user-images.githubusercontent.com/16585537/85942844-92d94b80-b95e-11ea-827e-a9185d648c70.png)
   > 
   > the third select box:
   > 
![image](https://user-images.githubusercontent.com/16585537/85943089-50187300-b960-11ea-953c-de1d15afa76f.png)
   
   sometime the dependency does not work!



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge removed a comment on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


super-sponge removed a comment on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722984


   > We have made changes to support multiple yarn clusters, using YARN CLI to 
obtain the state of the application
   
   does single yarn runing normal?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


super-sponge commented on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722984


   > We have made changes to support multiple yarn clusters, using YARN CLI to 
obtain the state of the application
   
   does single yarn runing normal?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge edited a comment on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


super-sponge edited a comment on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722697


   > > it occured when not enable HA. you should change HadoopUtils.Java code 
add appUrl = appAddress;
   > > ```
   > >  } else {
   > > //single resourcemanager enabled
   > > appUrl = appAddress;
   > > yarnEnabled = true;
   > > }
   > > ```
   > 
   > It's a bug. If not fit that bug, single resourcemanager application status 
url is blank String, will lead to error as above.
   
   yes!  fix the code ,build and replace the jar 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


super-sponge commented on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650722697


   > > it occured when not enable HA. you should change HadoopUtils.Java code 
add appUrl = appAddress;
   > > ```
   > >  } else {
   > > //single resourcemanager enabled
   > > appUrl = appAddress;
   > > yarnEnabled = true;
   > > }
   > > ```
   > 
   > It's a bug. If not fit that bug, single resourcemanager application status 
url is blank String, will lead to error as above.
   
   yes! 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread

2020-06-28 Thread GitBox


xingchun-chen commented on issue #3065:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3065#issuecomment-650722641


   Yes, the tenant running the workflow needs to be the same as the tenant who 
created the resource file



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] jxzdoing opened a new issue #3066: [QUESTION] Can't set dependency check

2020-06-28 Thread GitBox


jxzdoing opened a new issue #3066:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3066


   HI everyone,
   we have a lot of workflow in one project,those workflow was created by time 
order。when i need to set dependency check in 
   a workflow(it depends on a node in another workflow ),It's really strange,in 
the second select box,I can select the destination workflow,but in the third 
select box,the nodes display are not belong to the workflow which was selected 
in the second select box, its' belong to the workflow which was created last 
time,It's anyone has the same problem?
   
![image](https://user-images.githubusercontent.com/16585537/85942844-92d94b80-b95e-11ea-827e-a9185d648c70.png)
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] hlzhu1983 commented on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


hlzhu1983 commented on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650719612


   > it occured when not enable HA. you should change HadoopUtils.Java code add 
appUrl = appAddress;
   > 
   > ```
   >  } else {
   > //single resourcemanager enabled
   > appUrl = appAddress;
   > yarnEnabled = true;
   > }
   > ```
   
   It's a bug. If not fit that bug, single resourcemanager application status 
url is blank String, will lead to error as above.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] wa-ooo commented on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


wa-ooo commented on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650719000


   We have made changes to support multiple yarn clusters, using YARN CLI to 
obtain the state of the application



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] wa-ooo opened a new issue #3065: why use the tenant configuration of the workflow in the downloadResource method of taskExecuteThread

2020-06-28 Thread GitBox


wa-ooo opened a new issue #3065:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3065


   Why use the tenant configuration of the workflow in the downloadResource 
method of TaskExecuteThread. If a user is given resource permissions in user 
management, but the tenant of the running workflow is not a tenant of the 
resource, an error is reported that the resource file is not retrieved
   ==
   TaskExecuteThread的downloadResource 
方法中使用工作流的租户配置。如果在用户管理中给用户分配了资源权限,但是运行的工作流的租户并不是资源上传用户的租户,那么就会报获取不到资源文件的错误



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #2965: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)

2020-06-28 Thread GitBox


sonarcloud[bot] commented on pull request #2965:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2965#issuecomment-650716692


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL)
 [2 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list)
 [49.5% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #2965: [Feature-2925][server] Init TaskLogger in TaskExecuteProcessor (#2925)

2020-06-28 Thread GitBox


sonarcloud[bot] removed a comment on pull request #2965:
URL: 
https://github.com/apache/incubator-dolphinscheduler/pull/2965#issuecomment-650296143


   Kudos, SonarCloud Quality Gate passed!
   
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG)
 [0 
Bugs](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=BUG)
  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY)
 [0 
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=VULNERABILITY)
 (and [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT)
 [0 Security 
Hotspots](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=SECURITY_HOTSPOT)
 to review)  
   [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL)
 [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL)
 [2 Code 
Smells](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=2965=false=CODE_SMELL)
   
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list)
 [49.5% 
Coverage](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_coverage=list)
  
   [](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list)
 [0.0% 
Duplication](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler=2965=new_duplicated_lines_density=list)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch asf-site updated: Automated deployment: Sun Jun 28 07:13:43 UTC 2020 9e8d53c8a7b1151289dcc604a0497472f0d98b3b

2020-06-28 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch asf-site
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 4e2e427  Automated deployment: Sun Jun 28 07:13:43 UTC 2020 
9e8d53c8a7b1151289dcc604a0497472f0d98b3b
4e2e427 is described below

commit 4e2e42783c5cff22d127135b65ab86797b5c6186
Author: lenboo 
AuthorDate: Sun Jun 28 07:13:43 2020 +

Automated deployment: Sun Jun 28 07:13:43 UTC 2020 
9e8d53c8a7b1151289dcc604a0497472f0d98b3b
---
 en-us/docs/release/download.html | 12 
 en-us/docs/release/download.json |  2 +-
 2 files changed, 13 insertions(+), 1 deletion(-)

diff --git a/en-us/docs/release/download.html b/en-us/docs/release/download.html
index 842eed2..ed7667a 100644
--- a/en-us/docs/release/download.html
+++ b/en-us/docs/release/download.html
@@ -27,6 +27,18 @@
 
 
 
+Jun. 28th, 2020
+1.3.0
+Source code
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip;>[src]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc;>[asc]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512;>[sha512]
+
+
+
+
+Binary Distribution
+https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz;>[tar]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc;>[asc]
 https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512;
 [...]
+
+
 Feb. 24th, 2020
 1.2.1
 Source code
diff --git a/en-us/docs/release/download.json b/en-us/docs/release/download.json
index da08911..b62a7c2 100644
--- a/en-us/docs/release/download.json
+++ b/en-us/docs/release/download.json
@@ -1,6 +1,6 @@
 {
   "filename": "download.md",
-  "__html": "Download the DolphinScheduler releases\nUse the links 
below to download the Apache DolphinScheduler from one of our 
mirrors.\nOnly source code releases are official Apache 
releases: Windows and Linux binary distributions are just for end user 
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\nDownload the DolphinScheduler releases\nUse the links 
below to download the Apache DolphinScheduler from one of our 
mirrors.\nOnly source code releases are official Apache 
releases: Windows and Linux binary distributions are just for end user 
convenience.\nDolphinScheduler\n\n\n\nDate\nVersion\n\n

[GitHub] [incubator-dolphinscheduler-website] lenboo merged pull request #137: add 1.3.0 download links

2020-06-28 Thread GitBox


lenboo merged pull request #137:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/137


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[incubator-dolphinscheduler-website] branch master updated: add 1.3.0 download links (#137)

2020-06-28 Thread leonbao
This is an automated email from the ASF dual-hosted git repository.

leonbao pushed a commit to branch master
in repository 
https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git


The following commit(s) were added to refs/heads/master by this push:
 new 9e8d53c  add 1.3.0 download links (#137)
9e8d53c is described below

commit 9e8d53c8a7b1151289dcc604a0497472f0d98b3b
Author: bao liang <29528966+len...@users.noreply.github.com>
AuthorDate: Sun Jun 28 15:10:32 2020 +0800

add 1.3.0 download links (#137)

* test

* test

* change structure of documents

* add how to become a committer

* update documents

* update documents

* update

* update

* update

* update chinese to english

* add 1.3.0 download links

Co-authored-by: baoliang 
---
 docs/en-us/release/download.md | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/docs/en-us/release/download.md b/docs/en-us/release/download.md
index 35ac840..76dc8cc 100644
--- a/docs/en-us/release/download.md
+++ b/docs/en-us/release/download.md
@@ -8,6 +8,8 @@ Use the links below to download the Apache DolphinScheduler 
from one of our mirr
 ## DolphinScheduler
 | Date | Version| | Downloads |
 |:---:|:--:|:--:|:--:|
+| Jun. 28th, 2020 | 1.3.0 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-src.zip.sha512)|
+| | | Binary Distribution| 
[[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.3.0/apache-dolphinscheduler-incubating-1.3.0-dolphinscheduler-bin.tar.gz.sha512)|
 | Feb. 24th, 2020 | 1.2.1 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-src.zip.sha512)|
 | | | Binary Distribution| 
[[tar]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.1/apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz.sha512)|
 | Feb. 2th, 2020 | 1.2.0 | Source code| 
[[src]](https://www.apache.org/dyn/closer.cgi/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip)
 
[[asc]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.asc)
 
[[sha512]](https://downloads.apache.org/incubator/dolphinscheduler/1.2.0/apache-dolphinscheduler-incubating-1.2.0-src.zip.sha512)|



[GitHub] [incubator-dolphinscheduler-website] lenboo opened a new pull request #137: add 1.3.0 download links

2020-06-28 Thread GitBox


lenboo opened a new pull request #137:
URL: https://github.com/apache/incubator-dolphinscheduler-website/pull/137


   add 1.3.0 download links



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge edited a comment on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


super-sponge edited a comment on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650707983


it occured when not enable HA.  you should changeHadoopUtils.Java   
code  add   appUrl = appAddress;
 
} else {
   //single resourcemanager enabled
   appUrl = appAddress;
   yarnEnabled = true;
   }



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [incubator-dolphinscheduler] super-sponge commented on issue #3063: [QUESTION] worker get yarn application status failed

2020-06-28 Thread GitBox


super-sponge commented on issue #3063:
URL: 
https://github.com/apache/incubator-dolphinscheduler/issues/3063#issuecomment-650707983


HadoopUtils.Java   207 lines  
  } else {
   //single resourcemanager enabled
   appUrl = appAddress;
   yarnEnabled = true;
   }



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




svn commit: r40204 - /release/incubator/dolphinscheduler/KEYS

2020-06-28 Thread leonbao
Author: leonbao
Date: Sun Jun 28 06:34:50 2020
New Revision: 40204

Log:
transfer KEYS for 1.3.0

Added:
release/incubator/dolphinscheduler/KEYS
  - copied unchanged from r40203, dev/incubator/dolphinscheduler/KEYS



svn commit: r40203 - /release/incubator/dolphinscheduler/KEYS

2020-06-28 Thread leonbao
Author: leonbao
Date: Sun Jun 28 06:34:19 2020
New Revision: 40203

Log:
delete KEYS

Removed:
release/incubator/dolphinscheduler/KEYS



[GitHub] [incubator-dolphinscheduler] whitelowrie opened a new issue #3064: [BUG] com.sun.jna.platform.win32.Win32Exception: 占位程序接收到错误数据。when the WorkerServer work in the Windows

2020-06-28 Thread GitBox


whitelowrie opened a new issue #3064:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3064


   When I'm running the workerServer in Windows 10 System,I schedule a simple 
program like
   `dir`
   then the task run fail,and get some exception
   
![image](https://user-images.githubusercontent.com/13913085/85939830-138e4c80-b94b-11ea-99df-0b8cd63ad863.png)
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




svn commit: r40202 - /dev/incubator/dolphinscheduler/1.3.0/ /release/incubator/dolphinscheduler/1.3.0/

2020-06-28 Thread leonbao
Author: leonbao
Date: Sun Jun 28 06:08:25 2020
New Revision: 40202

Log:
transfer packages for 1.3.0

Added:
release/incubator/dolphinscheduler/1.3.0/
  - copied from r40201, dev/incubator/dolphinscheduler/1.3.0/
Removed:
dev/incubator/dolphinscheduler/1.3.0/



svn commit: r40200 - /release/incubator/dolphinscheduler/KEYS

2020-06-28 Thread leonbao
Author: leonbao
Date: Sun Jun 28 06:07:48 2020
New Revision: 40200

Log:
delete KEYS

Removed:
release/incubator/dolphinscheduler/KEYS



svn commit: r40201 - /release/incubator/dolphinscheduler/KEYS

2020-06-28 Thread leonbao
Author: leonbao
Date: Sun Jun 28 06:08:13 2020
New Revision: 40201

Log:
transfer KEYS for 1.3.0

Added:
release/incubator/dolphinscheduler/KEYS
  - copied unchanged from r40200, dev/incubator/dolphinscheduler/KEYS