[
https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153098#comment-17153098
]
Eric Payne commented on YARN-10343:
-----------------------------------
I see two major problems with this structure:
- Resource metrics in the overview section are not accurate. It could even show
0 resources if all nodes are labeled.
- Even in the apps section where used resources are show, reserved resources
are not show if the app runs in a labeled queue.
In the following cluster, there are 4 NodeManagers. Each node has 5GB memory
and 10 VCores. Each node in the cluster is labeled.
This results in the overview section showing that the cluster has 0 resources
for used, total, and reserved metrics, even though the apps section shows
memory and vcores being used.
However, even in the apps seciton, when an appis reserving memory and vcores,
it shows as 0 if the app is running in a labeled queue.
!Screen Shot 2020-07-07 at 1.03.26 PM.png!
In the nodes page, you can also see that the resources are being used even
though the overview section looks like there are no resources in the cluster:
!Screen Shot 2020-07-07 at 1.00.22 PM.png!
> Legacy RM UI should include labeled metrics for allocated, total, and
> reserved resources.
> -----------------------------------------------------------------------------------------
>
> Key: YARN-10343
> URL: https://issues.apache.org/jira/browse/YARN-10343
> Project: Hadoop YARN
> Issue Type: Improvement
> Affects Versions: 2.10.0, 3.2.1, 3.1.3
> Reporter: Eric Payne
> Assignee: Eric Payne
> Priority: Major
> Attachments: Screen Shot 2020-07-07 at 1.00.22 PM.png, Screen Shot
> 2020-07-07 at 1.03.26 PM.png
>
>
> The current legacy RM UI only includes resources metrics for the default
> partition. If a cluster has labeled nodes, those are not included in the
> resource metrics for allocated, total, and reserved resources.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
