[ https://issues.apache.org/jira/browse/YARN-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shilun Fan resolved YARN-11752. ------------------------------- Fix Version/s: 3.5.0 3.4.2 Hadoop Flags: Reviewed Target Version/s: 3.4.2 Resolution: Fixed > Global Scheduler : Improve the container allocation time > -------------------------------------------------------- > > Key: YARN-11752 > URL: https://issues.apache.org/jira/browse/YARN-11752 > Project: Hadoop YARN > Issue Type: Improvement > Reporter: Syed Shameerur Rahman > Assignee: Syed Shameerur Rahman > Priority: Major > Labels: pull-request-available > Fix For: 3.5.0, 3.4.2 > > > As part of YARN-10380, The allocation strategy for multi-mode/global > scheduler was changed from "node" list based to "partition" based, Due to > this change, After every two container allocation, the scheduler waits for *5 > milli seconds* by default as mentioned > [here|[https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java#L627].] > This significantly affects the container throughput. YARN SLS benchmark shows > Async scheduling was *6x* better than Global scheduling in terms of container > throughput for scheduling 1600 container with 50 nodes. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org