ruanwenjun commented on issue #17707: URL: https://github.com/apache/dolphinscheduler/issues/17707#issuecomment-3570954450
> Can you confirm if my understanding is correct? For example, suppose we have worker1 and worker2, and worker1 has more resources (such as CPU and memory) compared to worker2. > > In such an unbalanced cluster environment, I can set different concurrency limits for worker1 and worker2. For instance, on worker1, the concurrency for shell tasks can be set to 10, and for SQL tasks, it can be set to 5. Meanwhile, since worker2 has fewer resources, the concurrency for shell tasks on worker2 can be set to 5, and for SQL tasks, it can be set to 2. Yes, this is a use case. However, our worker node configurations are typically identical. We aim to support varying levels of concurrency for different tasks—for instance, SQL/HTTP tasks can handle higher concurrency, while shell tasks support lower concurrency. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
