[
https://issues.apache.org/jira/browse/YARN-10364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165502#comment-17165502
]
Prabhu Joseph commented on YARN-10364:
--------------------------------------
[~BilwaST] Yes right. One more place has similar check in
AbstractCSQueue#validateAbsoluteVsPercentageCapacityConfig
{code}
if (!minResource.equals(Resources.none())) {
localType = CapacityConfigType.ABSOLUTE_RESOURCE;
}
{code}
Any config which matches RESOURCE_PATTERN like [memory=0] or [vcores=0] has to
be considered as CapacityConfigType.ABSOLUTE_RESOURCE.
Need thorough testing to make sure that considering configs [memory=0] or
[vcores=0] as CapacityConfigType.ABSOLUTE_RESOURCE does not cause any failures
for a ParentQueue, LeafQueue, ManagedParentQueue and AutoCreatedLeafQueue.
> Absolute Resource [memory=0] is considered as Percentage config type
> --------------------------------------------------------------------
>
> Key: YARN-10364
> URL: https://issues.apache.org/jira/browse/YARN-10364
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 3.4.0
> Reporter: Prabhu Joseph
> Assignee: Bilwa S T
> Priority: Major
>
> Absolute Resource [memory=0] is considered as Percentage config type. This
> causes failure while converting queues from Percentage to Absolute Resources
> automatically.
> *Repro:*
> 1. Queue A = 100% and child queues Queue A.B = 0%, A.C=100%
> 2. While converting above to absolute resource automatically, capacity of
> queue A = [memory=<cluster resource>], A.B = [memory=0]
> This fails with below as A is considered as Absolute Resource whereas B is
> considered as Percentage config type.
> {code}
> 2020-07-23 09:36:40,499 WARN
> org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices:
> CapacityScheduler configuration validation failed:java.io.IOException: Failed
> to re-init queues : Parent queue 'root.A' and child queue 'root.A.B' should
> use either percentage based capacityconfiguration or absolute resource
> together for label:
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
