[
https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838055#comment-16838055
]
Prabhu Joseph commented on YARN-8625:
-------------------------------------
Thanks [~eepayne] for testing this. Both {{FileSystemApplicationHistoryStore}}
and {{MemoryApplicationHistoryStore}} are the history stores which won't store
the metrics. RM System metrics publisher publishes metrics which are stored by
{{ApplicationHistoryManagerOnTimelineStore}} (YARN-2033). Below settings will
enable the same.
{code:java}
yarn.timeline-service.enabled=true
yarn.timeline-service.generic-application-history.store-class=org.apache.hadoop.yarn.server.applicationhistoryservice.NullApplicationHistoryStore
yarn.timeline-service.version=1.5f
yarn.timeline-service.versions=1.5f
yarn.system-metrics-publisher.enabled=true
yarn.log.server.web-service.url=http://yarn-ats-1:8188/ws/v1/applicationhistory
yarn.timeline-service.webapp.address=yarn-ats-1:8188
{code}
{{ApplicationHistoryServer#createApplicationHistoryManager}} creates
{{ApplicationHistoryManagerOnTimelineStore}} when
{{yarn.timeline-service.generic-application-history.store-class}} is not set or
{{NullApplicationHistoryStore}}.
Tested with ATS1.5 ApplicationHistoryServer running and with AHS Rest Api
"http://<AHS Machine>:8188/ws/v1/applicationhistory/apps".
Attached complete yarn-site.xml for reference.
> Aggregate Resource Allocation for each job is not present in ATS
> ----------------------------------------------------------------
>
> Key: YARN-8625
> URL: https://issues.apache.org/jira/browse/YARN-8625
> Project: Hadoop YARN
> Issue Type: Bug
> Components: ATSv2
> Affects Versions: 2.7.4
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-8625.patch, 0002-YARN-8625.patch
>
>
> Aggregate Resource Allocation shown on RM UI for finished job is very useful
> metric to understand how much resource a job has consumed. But this does not
> get stored in ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
