good idea,you can refer this java class implementation: org.apache.dolphinscheduler.server.master.dispatch.host. LowerWeightHostManager > After ten minutes, its weight reaches the peak value, which is 10 I think this value of "ten minutes" can be make as config item, and the unit use seconds will be better
Best Regards --------------- DolphinScheduler(Incubator) PPMC Lidong Dai 代立冬 [email protected] --------------- Kirs <[email protected]> 于2020年6月22日周一 下午10:48写道: > Hello everyone, I want to enhance the function of ds load balancing. We > can set different weights for each worker, and perform a traffic > distribution according to the weight + load algorithm. At the same time, > considering the jit optimization, we should distribute its less traffic > when the machine is just started. We can use the startup time to calculate > one of its weights. For example, a worker has a weight of 10, and its > weight may be only 1. Take ten minutes of starting time as a latitude. > After ten minutes, its weight reaches the peak value, which is 10. In > addition, the load balancing can also be left as an spi for users to > expand. I sincerely hope to get everyone's suggestions, and then follow the > time nodes to complete it. > > > > | | > Kirs > | > | > 邮箱:[email protected] > | > > Signature is customized by Netease Mail Master
