[jira] [Commented] (YARN-448) Remove unnecessary hflush from log aggregation
[ https://issues.apache.org/jira/browse/YARN-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13593302#comment-13593302 ] Hudson commented on YARN-448: - Integrated in Hadoop-Yarn-trunk #146 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/146/]) YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via bobby) (Revision 1452475) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1452475 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/AggregatedLogFormat.java Remove unnecessary hflush from log aggregation -- Key: YARN-448 URL: https://issues.apache.org/jira/browse/YARN-448 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-beta Reporter: Kihwal Lee Assignee: Kihwal Lee Fix For: 3.0.0, 0.23.7, 2.0.4-beta Attachments: yarn-448.patch.txt AggregatedLogFormat#writeVersion() calls hflush() after writing the version. Calling hflush does not seem to be necessary. It can add a lot of load to hdfs in a big busy cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-448) Remove unnecessary hflush from log aggregation
[ https://issues.apache.org/jira/browse/YARN-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13593366#comment-13593366 ] Hudson commented on YARN-448: - Integrated in Hadoop-Hdfs-0.23-Build #544 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/544/]) svn merge -c 1452475 FIXES: YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via bobby) (Revision 1452478) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1452478 Files : * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/AggregatedLogFormat.java Remove unnecessary hflush from log aggregation -- Key: YARN-448 URL: https://issues.apache.org/jira/browse/YARN-448 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-beta Reporter: Kihwal Lee Assignee: Kihwal Lee Fix For: 3.0.0, 0.23.7, 2.0.4-beta Attachments: yarn-448.patch.txt AggregatedLogFormat#writeVersion() calls hflush() after writing the version. Calling hflush does not seem to be necessary. It can add a lot of load to hdfs in a big busy cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-448) Remove unnecessary hflush from log aggregation
[ https://issues.apache.org/jira/browse/YARN-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13592491#comment-13592491 ] Kihwal Lee commented on YARN-448: - Test not included since it does not affect normal cases. Even in failure cases, no current error handling in log aggregation is affected by the existence or absence of version record in a log that failed during aggregation. Remove unnecessary hflush from log aggregation -- Key: YARN-448 URL: https://issues.apache.org/jira/browse/YARN-448 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-beta Reporter: Kihwal Lee Assignee: Kihwal Lee Attachments: yarn-448.patch.txt AggregatedLogFormat#writeVersion() calls hflush() after writing the version. Calling hflush does not seem to be necessary. It can add a lot of load to hdfs in a big busy cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-448) Remove unnecessary hflush from log aggregation
[ https://issues.apache.org/jira/browse/YARN-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13592588#comment-13592588 ] Hudson commented on YARN-448: - Integrated in Hadoop-trunk-Commit #3412 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3412/]) YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via bobby) (Revision 1452475) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1452475 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/AggregatedLogFormat.java Remove unnecessary hflush from log aggregation -- Key: YARN-448 URL: https://issues.apache.org/jira/browse/YARN-448 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-beta Reporter: Kihwal Lee Assignee: Kihwal Lee Fix For: 3.0.0, 0.23.7, 2.0.4-beta Attachments: yarn-448.patch.txt AggregatedLogFormat#writeVersion() calls hflush() after writing the version. Calling hflush does not seem to be necessary. It can add a lot of load to hdfs in a big busy cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
