ruanwenjun commented on PR #9919: URL: https://github.com/apache/dolphinscheduler/pull/9919#issuecomment-1140147614
I don't see the whole code, in my knowledge, when master choose worker, it will follow the two steps: 1. Calculate the current load of each worker. 2. Find the minimum load worker and dispatch task. So we just need to add the worker's waiting task in heartbeat, and when master calculate the load it should consider the worker's waiting task is enough for this issue. Add worker reject command is another improvement, it's ok to me, it can protect the worker, but I think we don't need to cache the reject task, just consider it as unassign task is enough. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
