[
https://issues.apache.org/jira/browse/YARN-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406613#comment-15406613
]
Wangda Tan commented on YARN-5448:
----------------------------------
bq. One alternative i can think of is show these columns only when partitions
are not mapped to queues. and if value is zero then dont show, thoughts ?
Sounds like a plan
bq. One view point what i had for this was captured in the above comment , but
well again its a view point and debatable so dont have any hard restrictions on
having it.
This is majorly for answering questions like "why my total cluster resource
cannot be utilized", it should be already very clear for resource under each
partition even without this patch.
bq. May be i did not get the rationale behind "total non-usable resources"
would be better than "non-usable nodes", can elaborate more on your view on
this ?
Because resources of nodes should be heterogeneous. In our existing YARN web
UI, it shows total resource usage instead of total nodes usage (how many nodes
are using by applications). So total non-usable resources will be easier for
user to do calculations because non-usable = total - used - available
> Resource in Cluster Metrics is not sum of resources in all nodes of all
> partitions
> ----------------------------------------------------------------------------------
>
> Key: YARN-5448
> URL: https://issues.apache.org/jira/browse/YARN-5448
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacity scheduler, resourcemanager, webapp
> Affects Versions: 2.7.2
> Reporter: Naganarasimha G R
> Assignee: Naganarasimha G R
> Attachments: NodesPage.png, schedulerPage.png
>
>
> Currently Resource info from Cluster Metrics are got from Queue Metrics's
> *available resource + allocated resource*. Hence if there are some nodes
> which belongs to partition but if that partition is not associated with any
> queue then in the capacity scheduler partition hierarchy shows this nodes
> resources under its partition but Cluster metrics doesn't show.
> Apart from this in the Nodes page too Metrics overview table is shown. So if
> we show Resource info from Queue Metrics User will not be able to co relate
> it. (have attached the images for the same)
> IIUC idea of not showing in the *Metrics overview table* is to highlight that
> configuration is not proper. This needs to be some how conveyed through
> parititon-by-queue-hierarchy chart.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]