[ 
https://issues.apache.org/jira/browse/YARN-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406613#comment-15406613
 ] 

Wangda Tan commented on YARN-5448:
----------------------------------

bq. One alternative i can think of is show these columns only when partitions 
are not mapped to queues. and if value is zero then dont show, thoughts ?
Sounds like a plan

bq. One view point what i had for this was captured in the above comment , but 
well again its a view point and debatable so dont have any hard restrictions on 
having it.
This is majorly for answering questions like "why my total cluster resource 
cannot be utilized", it should be already very clear for resource under each 
partition even without this patch.

bq. May be i did not get the rationale behind "total non-usable resources" 
would be better than "non-usable nodes", can elaborate more on your view on 
this ?
Because resources of nodes should be heterogeneous. In our existing YARN web 
UI, it shows total resource usage instead of total nodes usage (how many nodes 
are using by applications). So total non-usable resources will be easier for 
user to do calculations because non-usable = total - used - available

> Resource in Cluster Metrics is not sum of resources in all nodes of all 
> partitions
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-5448
>                 URL: https://issues.apache.org/jira/browse/YARN-5448
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler, resourcemanager, webapp
>    Affects Versions: 2.7.2
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>         Attachments: NodesPage.png, schedulerPage.png
>
>
> Currently Resource info from Cluster Metrics are got from Queue Metrics's 
> *available resource + allocated resource*. Hence if there are some nodes 
> which belongs to partition but if that partition is not associated with any 
> queue then in the capacity scheduler partition hierarchy shows this nodes 
> resources under its partition but Cluster metrics doesn't show. 
> Apart from this in the Nodes page too Metrics overview table is shown. So if 
> we show Resource info from Queue Metrics User will not be able to co relate 
> it. (have attached the images for the same)
> IIUC idea of not showing in the *Metrics overview table* is to highlight that 
> configuration is not proper. This needs to be some how conveyed through  
> parititon-by-queue-hierarchy chart.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to