Tanu Ajmera created YARN-10589: ---------------------------------- Summary: Improve logic of multi-node allocation Key: YARN-10589 URL: https://issues.apache.org/jira/browse/YARN-10589 Project: Hadoop YARN Issue Type: Task Affects Versions: 3.3.0 Reporter: Tanu Ajmera Assignee: Tanu Ajmera Fix For: 3.4.0
{code:java} for (String partititon : partitions) { if (current++ > start) { break; } CandidateNodeSet<FiCaSchedulerNode> candidates = cs.getCandidateNodeSet(partititon); if (candidates == null) { continue; } cs.allocateContainersToNode(candidates, false); }{code} In above logic, if we have thousands of node in one partition, we will still repeatedly access all nodes of the partition thousands of times. There is no break point where if the partition is not same, it should stop checking other nodes in that partition. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org