Tanu Ajmera created YARN-10589:
----------------------------------
Summary: Improve logic of multi-node allocation
Key: YARN-10589
URL: https://issues.apache.org/jira/browse/YARN-10589
Project: Hadoop YARN
Issue Type: Task
Affects Versions: 3.3.0
Reporter: Tanu Ajmera
Assignee: Tanu Ajmera
Fix For: 3.4.0
{code:java}
for (String partititon : partitions) {
if (current++ > start) {
break;
}
CandidateNodeSet<FiCaSchedulerNode> candidates =
cs.getCandidateNodeSet(partititon);
if (candidates == null) {
continue;
}
cs.allocateContainersToNode(candidates, false);
}{code}
In above logic, if we have thousands of node in one partition, we will still
repeatedly access all nodes of the partition thousands of times. There is no
break point where if the partition is not same, it should stop checking other
nodes in that partition.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
