[
https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth updated YARN-7451:
---------------------------------
Description:
Originally, this issue was about serializing custom resources along with normal
resources in the RM apps and scheduler webservice endpoints.
However, as YARN-7817 implemented this sooner, this issue is a complement of
YARN-7817, adding several unit tests to verify the correctness of the responses
of these webservice endpoints.
was:
When running jobs that request resource types the RM Cluster Apps API should
include this in the "resourceRequests" object.
Additionally, when calling the RM scheduler API it returns:
{noformat}
"childQueues": {
"queue": [
{
"allocatedContainers": 101,
"amMaxResources": {
"memory": 320390,
"vCores": 192
},
"amUsedResources": {
"memory": 1024,
"vCores": 1
},
"clusterResources": {
"memory": 640779,
"vCores": 384
},
"demandResources": {
"memory": 103424,
"vCores": 101
},
"fairResources": {
"memory": 640779,
"vCores": 384
},
"maxApps": 2147483647,
"maxResources": {
"memory": 640779,
"vCores": 384
},
"minResources": {
"memory": 0,
"vCores": 0
},
"numActiveApps": 1,
"numPendingApps": 0,
"preemptable": true,
"queueName": "root.users.systest",
"reservedContainers": 0,
"reservedResources": {
"memory": 0,
"vCores": 0
},
"schedulingPolicy": "fair",
"steadyFairResources": {
"memory": 320390,
"vCores": 192
},
"type": "fairSchedulerLeafQueueInfo",
"usedResources": {
"memory": 103424,
"vCores": 101
}
}
]
{noformat}
However, the web UI shows resource types usage.
> Add missing tests to verify the presence custom resources of RM apps and
> scheduler webservice endpoints
> -------------------------------------------------------------------------------------------------------
>
> Key: YARN-7451
> URL: https://issues.apache.org/jira/browse/YARN-7451
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager, restapi
> Affects Versions: 3.0.0
> Reporter: Grant Sohn
> Assignee: Szilard Nemeth
> Priority: Major
> Attachments: YARN-7451.001.patch, YARN-7451.002.patch,
> YARN-7451.003.patch, YARN-7451.004.patch, YARN-7451.005.patch,
> YARN-7451.006.patch, YARN-7451.007.patch, YARN-7451.008.patch,
> YARN-7451.009.patch, YARN-7451.010.patch, YARN-7451.011.patch,
> YARN-7451.012.patch,
> YARN-7451__Expose_custom_resource_types_on_RM_scheduler_API_as_flattened_map01_02.patch
>
>
>
> Originally, this issue was about serializing custom resources along with
> normal resources in the RM apps and scheduler webservice endpoints.
> However, as YARN-7817 implemented this sooner, this issue is a complement of
> YARN-7817, adding several unit tests to verify the correctness of the
> responses of these webservice endpoints.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
