[
https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16777834#comment-16777834
]
Prabhu Joseph commented on YARN-8625:
-------------------------------------
Thanks [~rohithsharma] for the review. This works fine for completed
applications as well. Below is the test result where
{{aggregateResourceAllocation}} reflects for completed jobs.
{{ApplicationHistoryManagerOnTimelineStore}} gets these information from
{{ApplicationMetricsConstants.APP_CPU_METRICS}} published by
{{SystemMetricsPublisher}} on appFinished.
{code}
curl --negotiate -u: http://172.26.73.192:8188/ws/v1/applicationhistory/apps
{"appId":"application_1547642851023_0014","currentAppAttemptId":"appattempt_1547642851023_0014_000001","user":"ambari-qa","name":"word
count","queue":"default","type":"MAPREDUCE","host":"pjosephdocker-3.openstacklocal","rpcPort":35530,"appState":"FINISHED","runningContainers":0,"progress":100.0,"diagnosticsInfo":"","originalTrackingUrl":"http://pjosephdocker-2.openstacklocal:19888/jobhistory/job/job_1547642851023_0014","trackingUrl":"http://pjosephdocker-1.openstacklocal:8088/proxy/application_1547642851023_0014/","finalAppStatus":"SUCCEEDED","submittedTime":1547713937861,"startedTime":1547713937861,"finishedTime":1547714027192,"elapsedTime":89331,"priority":0,"allocatedCpuVcores":0,"allocatedMemoryMB":0,"reservedCpuVcores":0,"reservedMemoryMB":0,"unmanagedApplication":false,"appNodeLabelExpression":";<Not
set>","amNodeLabelExpression":"<DEFAULT_PARTITION>",{color:#d04437}"aggregateResourceAllocation":"124924
MB-seconds, 112 vcore-seconds","aggregatePreemptedResourceAllocation":"0
MB-seconds, 0 vcore-seconds"{color}}
{code}
> Aggregate Resource Allocation for each job is not present in ATS
> ----------------------------------------------------------------
>
> Key: YARN-8625
> URL: https://issues.apache.org/jira/browse/YARN-8625
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 2.7.4
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-8625.patch, 0002-YARN-8625.patch
>
>
> Aggregate Resource Allocation shown on RM UI for finished job is very useful
> metric to understand how much resource a job has consumed. But this does not
> get stored in ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
