leehom opened a new issue #3072:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3072
sharding or Paralleling is important feature for for scheduler,i have
some idea about that,for ds to implementing sharding or sharding easily。
1. changing the dag to chain,en,we can say it Dimension reducing
2. adding Parallism property to node of chain
3. when buiding the chaining task of the job, api can build dag according to
the Parallism of the node
at all,something like flink, streaming graph, job graph, execution graph
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]