[
https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781840#comment-16781840
]
Eric Payne commented on YARN-8625:
----------------------------------
bq. Prabhu Joseph These metrics holds good for running applications. ATS
doesn't have these data. Always ApplicationHistoryManagerOnTimelineStore
constructs with empty resources.
[~Prabhu Joseph], I think [~rohithsharma] is correct. This only works as long
as the RMApps are still in the RM's app list. For very busy clusters (like what
we are running), the RM app list gets turned over within an hour or so
(depending on the value of
{{yarn.resourcemanager.max-completed-applications}}). There needs to be
additional code to log this information in the AHS before it is lost from the
RM app list.
> Aggregate Resource Allocation for each job is not present in ATS
> ----------------------------------------------------------------
>
> Key: YARN-8625
> URL: https://issues.apache.org/jira/browse/YARN-8625
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 2.7.4
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-8625.patch, 0002-YARN-8625.patch
>
>
> Aggregate Resource Allocation shown on RM UI for finished job is very useful
> metric to understand how much resource a job has consumed. But this does not
> get stored in ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
