[
https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782281#comment-16782281
]
Prabhu Joseph commented on YARN-8625:
-------------------------------------
[~eepayne] RM already publishes this information into ATS when the application
is finished in {{TimelineServiceV1Publisher#appFinished}}
{code}
RMAppMetrics appMetrics = app.getRMAppMetrics();
entity.addOtherInfo(ApplicationMetricsConstants.APP_CPU_METRICS,
appMetrics.getVcoreSeconds());
entity.addOtherInfo(ApplicationMetricsConstants.APP_MEM_METRICS,
appMetrics.getMemorySeconds());
{code}
{{ApplicationHistoryManagerOnTimelineStore}} also reads this and sets in
{{ApplicationResourceUsageReport}} part of {{ApplicationReportExt}}.
{code}
if (entityInfo.containsKey(ApplicationMetricsConstants.APP_CPU_METRICS)) {
long vcoreSeconds = parseLong(entityInfo,
ApplicationMetricsConstants.APP_CPU_METRICS);
long memorySeconds = parseLong(entityInfo,
ApplicationMetricsConstants.APP_MEM_METRICS);
{code}
The issue is it was ignored in AppInfo.
Have tested with yarn.resourcemanager.max-completed-applications = 0 and ATS
shows the aggregate resource information for completed jobs.
> Aggregate Resource Allocation for each job is not present in ATS
> ----------------------------------------------------------------
>
> Key: YARN-8625
> URL: https://issues.apache.org/jira/browse/YARN-8625
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 2.7.4
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-8625.patch, 0002-YARN-8625.patch
>
>
> Aggregate Resource Allocation shown on RM UI for finished job is very useful
> metric to understand how much resource a job has consumed. But this does not
> get stored in ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
