[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305259#comment-14305259 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2045 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2045/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305206#comment-14305206 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #95 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/95/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305125#comment-14305125 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #91 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/91/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305098#comment-14305098 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2026 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2026/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304932#comment-14304932 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-Yarn-trunk #828 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/828/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304917#comment-14304917 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #94 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/94/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304837#comment-14304837 ] Naganarasimha G R commented on YARN-2543: - Thanks for Reviewing and committing [~zjshen]... > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304470#comment-14304470 ] Hudson commented on YARN-2543: -- FAILURE: Integrated in Hadoop-trunk-Commit #6997 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6997/]) YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. (zjshen: rev e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/TestSystemMetricsPublisher.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/ApplicationFinishedEvent.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/ApplicationMetricsConstants.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerOnTimelineStore.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Fix For: 2.7.0 > > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304445#comment-14304445 ] Zhijie Shen commented on YARN-2543: --- +1 LGTM will commit > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[
https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14303834#comment-14303834
]
Hadoop QA commented on YARN-2543:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12696232/YARN-2543.20150203-1.patch
against trunk revision 80705e0.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/6493//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6493//console
This message is automatically generated.
> Resource usage should be published to the timeline server as well
> -
>
> Key: YARN-2543
> URL: https://issues.apache.org/jira/browse/YARN-2543
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Affects Versions: 2.6.0
>Reporter: Zhijie Shen
>Assignee: Naganarasimha G R
> Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch,
> YARN-2543.20150131-1.patch, YARN-2543.20150203-1.patch
>
>
> RM will include the resource usage in the app report, but generic history
> service doesn't, because RM doesn't publish this data to the timeline server
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302539#comment-14302539 ] Zhijie Shen commented on YARN-2543: --- bq. So only variation would be that it will not show "N/A" instead will show 0. Yes, sorry for the confusion. Let's keep the behavior consistent when the resource info is not available. > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302512#comment-14302512 ] Naganarasimha G R commented on YARN-2543: - Hi [~zjshen] In this patch i had ensured Null pointer exception doesn't happen in CLI by modifying server side such that ApplicationResourceUsageReport is initiaslized with default value (0). So only variation would be that it will not show "N/A" instead will show 0. So please inform If you want "N/A" to be shown from CLI if no resource usage is present in DB, then will revert back the changes with 2542 modifications being present... > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301967#comment-14301967 ] Zhijie Shen commented on YARN-2543: --- My bad. It seems we still need to check whether mem/vcore is set or not in ApplicationCLI, and return "n/a" given not. This is for backward compatibility. The code may be upgraded to 2.7, while the database contains the data that is written by the timeline server prior to 2.7 and doesn't have the resource info. > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch, > YARN-2543.20150131-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[
https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299611#comment-14299611
]
Hadoop QA commented on YARN-2543:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12695701/YARN-2543.20150131-1.patch
against trunk revision 09ad9a8.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:red}-1 release audit{color}. The applied patch generated 1
release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.client.TestResourceTrackerOnHA
org.apache.hadoop.yarn.client.TestApplicationClientProtocolOnHA
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/6473//testReport/
Release audit warnings:
https://builds.apache.org/job/PreCommit-YARN-Build/6473//artifact/patchprocess/patchReleaseAuditProblems.txt
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6473//console
This message is automatically generated.
> Resource usage should be published to the timeline server as well
> -
>
> Key: YARN-2543
> URL: https://issues.apache.org/jira/browse/YARN-2543
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Affects Versions: 2.6.0
>Reporter: Zhijie Shen
>Assignee: Naganarasimha G R
> Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch,
> YARN-2543.20150131-1.patch
>
>
> RM will include the resource usage in the app report, but generic history
> service doesn't, because RM doesn't publish this data to the timeline server
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[ https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299317#comment-14299317 ] Zhijie Shen commented on YARN-2543: --- Can you check the test failure in TestSystemMetricsPublisher? > Resource usage should be published to the timeline server as well > - > > Key: YARN-2543 > URL: https://issues.apache.org/jira/browse/YARN-2543 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 2.6.0 >Reporter: Zhijie Shen >Assignee: Naganarasimha G R > Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch > > > RM will include the resource usage in the app report, but generic history > service doesn't, because RM doesn't publish this data to the timeline server -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[
https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299123#comment-14299123
]
Hadoop QA commented on YARN-2543:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12695578/YARN-2543.20150130-1.patch
against trunk revision f2c9109.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:red}-1 release audit{color}. The applied patch generated 1
release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler
org.apache.hadoop.yarn.server.resourcemanager.metrics.TestSystemMetricsPublisher
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/6467//testReport/
Release audit warnings:
https://builds.apache.org/job/PreCommit-YARN-Build/6467//artifact/patchprocess/patchReleaseAuditProblems.txt
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6467//console
This message is automatically generated.
> Resource usage should be published to the timeline server as well
> -
>
> Key: YARN-2543
> URL: https://issues.apache.org/jira/browse/YARN-2543
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Affects Versions: 2.6.0
>Reporter: Zhijie Shen
>Assignee: Naganarasimha G R
> Attachments: YARN-2543.20150125-1.patch, YARN-2543.20150130-1.patch
>
>
> RM will include the resource usage in the app report, but generic history
> service doesn't, because RM doesn't publish this data to the timeline server
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[
https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294307#comment-14294307
]
Zhijie Shen commented on YARN-2543:
---
Thanks for the patch, Naga! Here're my comments.
1. I suggested to add this info as the app entity-level otherinfo. You can
check other fields like queue, type and so on.
{code}
+eventInfo.put(ApplicationMetricsConstants.APP_CPU_METRICS,
+appMetrics.getVcoreSeconds());
+eventInfo.put(ApplicationMetricsConstants.APP_MEM_METRICS,
+appMetrics.getMemorySeconds());
{code}
2. ApplicationCLI and the corresponding test case needs to be changed too.
{code}
if (usageReport != null) {
//completed app report in the timeline server doesn't have usage report
appReportStr.print(usageReport.getMemorySeconds() + " MB-seconds, ");
appReportStr.println(usageReport.getVcoreSeconds() + " vcore-seconds");
} else {
appReportStr.println("N/A");
}
{code}
3. Add the assertions in TestApplicationHistoryClientService too.
4. It seems CLI provides the resource usage info. It's better that the webUI
can provide the same info. However, rm app info can contain this info, too. But
let's separate this issue and cover it in another Jira.
> Resource usage should be published to the timeline server as well
> -
>
> Key: YARN-2543
> URL: https://issues.apache.org/jira/browse/YARN-2543
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Affects Versions: 2.6.0
>Reporter: Zhijie Shen
>Assignee: Naganarasimha G R
> Attachments: YARN-2543.20150125-1.patch
>
>
> RM will include the resource usage in the app report, but generic history
> service doesn't, because RM doesn't publish this data to the timeline server
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-2543) Resource usage should be published to the timeline server as well
[
https://issues.apache.org/jira/browse/YARN-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291018#comment-14291018
]
Hadoop QA commented on YARN-2543:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12694416/YARN-2543.20150125-1.patch
against trunk revision 3703965.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/6413//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6413//console
This message is automatically generated.
> Resource usage should be published to the timeline server as well
> -
>
> Key: YARN-2543
> URL: https://issues.apache.org/jira/browse/YARN-2543
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Affects Versions: 2.6.0
>Reporter: Zhijie Shen
>Assignee: Naganarasimha G R
> Attachments: YARN-2543.20150125-1.patch
>
>
> RM will include the resource usage in the app report, but generic history
> service doesn't, because RM doesn't publish this data to the timeline server
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
