[GitHub] [dolphinscheduler] zhuxt2015 opened a new issue, #10996: [Improvement][Master] Improve task dispatch to batch dispatch

Fri, 15 Jul 2022 00:56:08 -0700 


zhuxt2015 opened a new issue, #10996:
URL: https://github.com/apache/dolphinscheduler/issues/10996

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and 
found no similar feature requirement.
   
   
   ### Description
   
   ## 目前的task分发逻辑问题
   1、没有考虑worker的负载和可用内存的因素
   2、一次只分发一个task给worker
   
   ## 优化
   1、批量分配task
   2、超过负载的worker暂时不分发task
   3、分发task的数量参考当前worker可用的内存大小
   
   ## 流程图
   
![task批量分发](https://user-images.githubusercontent.com/13765310/179178765-b4e6d56e-9a69-476a-b2c6-13234ed678e7.jpg)
   
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: 
[email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to