[
https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261961#comment-17261961
]
Benjamin Teke commented on YARN-10504:
--------------------------------------
[~wangda], [~zhuqi]
Added a small new patch. ver.6 had a small issue in
ParentQueue.getCapacityConfigurationTypeForQueues, where if the passed queues
collection was empty the iterator where the mixed mode check was implemented
threw a NoSuchElementException, causing all of the AutoCreatedTests to fail.
Also setChildQueues has a similar mixed mode check, where the root queue is
included in the check, causing an unnecessary exception. So I extended that if
as well. Additionally I added [~zhuqi]'s suggestion to
LeafQueue.updateClusterResource.
There is one more issue: now 2 of the TestAbsoluteResourceWithAutoQueue tests
are failing, because the apps are stuck in SUBMITTED state. [~wangda] do you
have an idea on this one?
> Implement weight mode in Capacity Scheduler
> -------------------------------------------
>
> Key: YARN-10504
> URL: https://issues.apache.org/jira/browse/YARN-10504
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Benjamin Teke
> Assignee: Benjamin Teke
> Priority: Major
> Attachments: YARN-10504.001.patch, YARN-10504.002.patch,
> YARN-10504.003.patch, YARN-10504.004.patch, YARN-10504.005.patch,
> YARN-10504.006.patch, YARN-10504.007.patch, YARN-10504.ver-1.patch,
> YARN-10504.ver-2.patch, YARN-10504.ver-3.patch
>
>
> To allow the possibility to flexibly create queues in Capacity Scheduler a
> weight mode should be introduced. The existing \{{capacity }}property should
> be used with a different syntax, i.e:
> root.users.capacity = (1.0) or ~1.0 or ^1.0 or @1.0
> root.users.capacity = 1.0w
> root.users.capacity = w:1.0
> Weight support should not impact the existing functionality.
>
> The new functionality should:
> * accept and validate the new weight values
> * enforce a singular mode on the whole queue tree
> * (re)calculate the relative (percentage-based) capacities based on the
> weights during launch and every time the queue structure changes
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
