This is an automated email from the ASF dual-hosted git repository. slfan1989 pushed a commit to branch branch-3.4.0 in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.4.0 by this push: new 7e2edd8c5d1f HADOOP-19051: Highlight Capacity Scheduler new features in release for the release 3.4.0 (#6500) Contributed by Benjamin Teke. 7e2edd8c5d1f is described below commit 7e2edd8c5d1f551d81b115d3d1765f965470fccc Author: Benjamin Teke <brumi1...@users.noreply.github.com> AuthorDate: Fri Jan 26 06:33:55 2024 +0100 HADOOP-19051: Highlight Capacity Scheduler new features in release for the release 3.4.0 (#6500) Contributed by Benjamin Teke. Signed-off-by: Shilun Fan <slfan1...@apache.org> --- hadoop-project/src/site/markdown/index.md.vm | 21 +++++++++++++++++++++ 1 file changed, 21 insertions(+) diff --git a/hadoop-project/src/site/markdown/index.md.vm b/hadoop-project/src/site/markdown/index.md.vm index f3f9c41deb5c..7c1b3ef5eb40 100644 --- a/hadoop-project/src/site/markdown/index.md.vm +++ b/hadoop-project/src/site/markdown/index.md.vm @@ -57,6 +57,27 @@ We have enhanced the YARN Federation functionality for improved usability. The e 6. The page function of the router has been enhanced. 7. A set of commands has been added to the Router side for operating on SubClusters and Policies. +YARN Capacity Scheduler improvements +---------------------------------------- + +[YARN-10496](https://issues.apache.org/jira/browse/YARN-10496) Support Flexible Auto Queue Creation in Capacity Scheduler + +Capacity Scheduler resource distribution mode was extended with a new allocation mode called weight mode. +Defining queue capacities with weights allows the users to use the newly added flexible queue auto creation mode. +Flexible mode now supports the dynamic creation of both **parent queues** and **leaf queues**, enabling the creation of +complex queue hierarchies application submission time. + +[YARN-10888](https://issues.apache.org/jira/browse/YARN-10888) New capacity modes for Capacity Scheduler + +Capacity Scheduler's resource distribution was completely refactored to be more flexible and extensible. There is a new concept +called Capacity Vectors, which allows the users to mix various resource types in the hierarchy, and also in a single queue. With +this optionally enabled feature it is now possible to define different resources with different units, like memory with GBs, vcores with +percentage values, and GPUs/FPGAs with weights, all in the same queue. + +[YARN-10889](https://issues.apache.org/jira/browse/YARN-10889) Queue Creation in Capacity Scheduler - Various improvements + +In addition to the two new features above, there were a number of commits for improvements and bug fixes in Capacity Scheduler. + HDFS RBF: Code Enhancements, New Features, and Bug Fixes ---------------------------------------- --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org