[
https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180687#comment-15180687
]
Eric Payne commented on YARN-4751:
----------------------------------
{quote}
In that patch, I added one method in AbstractCSQueue named
getNodeLabelsForQueue.
This will get all valid labels for a queue. We may not need to go over all
labels in cluster here. So could we take that code alone here, and use the same
in the current uploaded patch. Does it make sense? thoughts?
{quote}
Thanks, [~sunilg], for pointing out {{getNodeLabelsForQueue}} from YARN-4304.
Unfortunately, that method looks like it depends on
{{QueueCapacities#getNodePartitionsSet}} and
{{ResourceUsage#getNodePartitionsSet}}, which were implemented as part of
YARN-2696. I am afraid that once we start pulling on that dependency chain, it
will get complicated very quickly.
AFAICT, including all cluster node labels as implemented in the current patch
will produce the correct results, it just may traverse more labels than it
needs to, and the non-relevant ones will result in 0. Including all relevant
labels is especially important when calculating values for the used capacity
bar graph to be displayed on the parent and root queues' bar graphs in the
capacity scheduler UI page.
> In 2.7, Labeled queue usage not shown properly in capacity scheduler UI
> -----------------------------------------------------------------------
>
> Key: YARN-4751
> URL: https://issues.apache.org/jira/browse/YARN-4751
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacity scheduler, yarn
> Affects Versions: 2.7.3
> Reporter: Eric Payne
> Assignee: Eric Payne
> Attachments: 2.7 CS UI No BarGraph.jpg, YARH-4752-branch-2.7.001.patch
>
>
> In 2.6 and 2.7, the capacity scheduler UI does not have the queue graphs
> separated by partition. When applications are running on a labeled queue, no
> color is shown in the bar graph, and several of the "Used" metrics are zero.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)