[
https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745880#comment-16745880
]
Prabhu Joseph edited comment on YARN-8625 at 1/18/19 8:19 AM:
--------------------------------------------------------------
[~kshukla] Thanks for the review. Attached patch with checkstyle issues fixed.
The field Aggregate Resource Allocation were part of ApplicationReport prepared
by AHSWebServices but not set in AppInfo. Setting in AppInfo outputs to
AHSWebServices response.
{code}
curl --negotiate -u: http://172.26.73.192:8188/ws/v1/applicationhistory/apps
{"appId":"application_1547642851023_0014","currentAppAttemptId":"appattempt_1547642851023_0014_000001","user":"ambari-qa","name":"word
count","queue":"default","type":"MAPREDUCE","host":"pjosephdocker-3.openstacklocal","rpcPort":35530,"appState":"FINISHED","runningContainers":0,"progress":100.0,"diagnosticsInfo":"","originalTrackingUrl":"http://pjosephdocker-2.openstacklocal:19888/jobhistory/job/job_1547642851023_0014","trackingUrl":"http://pjosephdocker-1.openstacklocal:8088/proxy/application_1547642851023_0014/","finalAppStatus":"SUCCEEDED","submittedTime":1547713937861,"startedTime":1547713937861,"finishedTime":1547714027192,"elapsedTime":89331,"priority":0,"allocatedCpuVcores":0,"allocatedMemoryMB":0,"reservedCpuVcores":0,"reservedMemoryMB":0,"unmanagedApplication":false,"appNodeLabelExpression":";<Not
set>","amNodeLabelExpression":"<DEFAULT_PARTITION>",{color:#d04437}"aggregateResourceAllocation":"124924
MB-seconds, 112 vcore-seconds","aggregatePreemptedResourceAllocation":"0
MB-seconds, 0 vcore-seconds"{color}}
{code}
was (Author: prabhu joseph):
[~kshukla] Thanks for the review. Attached patch with checkstyle issues fixed.
The field Aggregate Resource Allocation were part of ApplicationReport prepared
by AHSWebServices but not set in AppInfo. Setting in AppInfo outputs to
AHSWebServices response.
{code}
curl --negotiate -u: http://172.26.73.192:8188/ws/v1/applicationhistory/apps
{"appId":"application_1547642851023_0014","currentAppAttemptId":"appattempt_1547642851023_0014_000001","user":"ambari-qa","name":"word
count","queue":"default","type":"MAPREDUCE","host":"pjosephdocker-3.openstacklocal","rpcPort":35530,"appState":"FINISHED","runningContainers":0,"progress":100.0,"diagnosticsInfo":"","originalTrackingUrl":"http://pjosephdocker-2.openstacklocal:19888/jobhistory/job/job_1547642851023_0014","trackingUrl":"http://pjosephdocker-1.openstacklocal:8088/proxy/application_1547642851023_0014/","finalAppStatus":"SUCCEEDED","submittedTime":1547713937861,"startedTime":1547713937861,"finishedTime":1547714027192,"elapsedTime":89331,"priority":0,"allocatedCpuVcores":0,"allocatedMemoryMB":0,"reservedCpuVcores":0,"reservedMemoryMB":0,"unmanagedApplication":false,"appNodeLabelExpression":";<Not
set>","amNodeLabelExpression":"<DEFAULT_PARTITION>",{color:#333333}{color:#f79232}"aggregateResourceAllocation":"124924
MB-seconds, 112 vcore-seconds","aggregatePreemptedResourceAllocation":"0
MB-seconds, 0 vcore-seconds"{color}{color}}
{code}
> Aggregate Resource Allocation for each job is not present in ATS
> ----------------------------------------------------------------
>
> Key: YARN-8625
> URL: https://issues.apache.org/jira/browse/YARN-8625
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 2.7.4
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-8625.patch, 0002-YARN-8625.patch
>
>
> Aggregate Resource Allocation shown on RM UI for finished job is very useful
> metric to understand how much resource a job has consumed. But this does not
> get stored in ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
