[
https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282328#comment-17282328
]
Bilwa S T edited comment on YARN-10588 at 2/10/21, 9:19 AM:
------------------------------------------------------------
Thanks [~epayne] [~Jim_Brennan] for taking a look at this issue.
I added change in FicaSchedulerApp.java as same issue can occur ie cluster and
queue resource will not be calculated if one of the resource is zero. I added
instanceOf check because that method is applicable only for capacityscheduler .
Many testcases were failing once i removed
DominantResourceCalculator.isInvalidDivisor() check as testcases had configured
Fifoscheduler.
was (Author: bilwast):
Hi [~epayne]
I added change in FicaSchedulerApp.java as same issue can occur ie cluster and
queue resource will not be calculated if one of the resource is zero. I added
instanceOf check because that method is applicable only for capacityscheduler .
Many testcases were failing once i removed
DominantResourceCalculator.isInvalidDivisor() check as testcases had configured
Fifoscheduler.
> Percentage of queue and cluster is zero in WebUI
> -------------------------------------------------
>
> Key: YARN-10588
> URL: https://issues.apache.org/jira/browse/YARN-10588
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Bilwa S T
> Assignee: Bilwa S T
> Priority: Major
> Attachments: YARN-10588.001.patch, YARN-10588.002.patch,
> YARN-10588.003.patch
>
>
> Steps to reproduce:
> Configure below property in resource-types.xml
> {code:java}
> <property>
> <name>yarn.resource-types</name>
> <value>yarn.io/gpu</value>
> </property>{code}
> Submit a job
> In UI you can see % Of Queue and % Of Cluster is zero for the submitted
> application
>
> This is because in SchedulerApplicationAttempt has below check for
> calculating queueUsagePerc and clusterUsagePerc
> {code:java}
> if (!calc.isInvalidDivisor(cluster)) {
> float queueCapacityPerc = queue.getQueueInfo(false, false)
> .getCapacity();
> queueUsagePerc = calc.divide(cluster, usedResourceClone,
> Resources.multiply(cluster, queueCapacityPerc)) * 100;
> if (Float.isNaN(queueUsagePerc) || Float.isInfinite(queueUsagePerc)) {
> queueUsagePerc = 0.0f;
> }
> clusterUsagePerc =
> calc.divide(cluster, usedResourceClone, cluster) * 100;
> }
> {code}
> calc.isInvalidDivisor(cluster) always returns true as gpu resource is 0
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
