KEN-LJQ opened a new issue #1319: [Feature] Parallel complement data support 
concurrency control
URL: https://github.com/apache/incubator-dolphinscheduler/issues/1319
 
 
   **New feature expected**
   When complement data with parallel execution mode, consider add a 
concurrency control configuration would be better, so that we can limit how 
many process instance are running at the same time.
   
   **Current problem**
   Sometimes we will complement data for many days, like several  weeks or 
month, and we will choose parallel execution mode to make it run faster. But we 
found out dolphin scheduler will generate all process instance and submit all 
of them.
   That's not what we want, because we just want the complement to run faster, 
like only 3 instance at the same time, and don't want it use all cluster 
resource.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to