leehom edited a comment on issue #3072: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3072#issuecomment-657403190
 i agree all that Data processing is the matter of job itself, but sharding support would be the matter of scheduler engine，follow is what i had said，what it mean is how ds to support sharding or Paralleling task，not data processing > sharding or Paralleling task is important feature for scheduler，i have some idea about that，for ds to implementing sharding or Paralling easily。 > > 1. changing the dag to chain，en，we can say it Dimension reducing > 2. adding Parallism property to node of chain > 3. when buiding the chaining task of the job, api can build dag according to the Parallism of the node > something like flink, streaming graph, job graph, execution graph ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
