[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676968#comment-13676968 ] Hudson commented on YARN-742: - Integrated in Hadoop-Hdfs-0.23-Build #630 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/630/]) YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe. (Revision 1489981) Result = SUCCESS kihwal : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1489981 Files : * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/LogAggregationService.java * /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Fix For: 3.0.0, 2.1.0-beta, 0.23.9 Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677050#comment-13677050 ] Kihwal Lee commented on YARN-742: - I've noticed a new kind of HDFS integration failures recently. This time, it is caused by TestNNThroughputBenchmark exiting prematurely. Will file a jira if not reported already. Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Fix For: 3.0.0, 2.1.0-beta, 0.23.9 Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675790#comment-13675790 ] Hudson commented on YARN-742: - Integrated in Hadoop-Yarn-trunk #231 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/231/]) YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe. (Revision 1489596) Result = SUCCESS kihwal : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1489596 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/LogAggregationService.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675886#comment-13675886 ] Hudson commented on YARN-742: - Integrated in Hadoop-Hdfs-trunk #1421 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1421/]) YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe. (Revision 1489596) Result = FAILURE kihwal : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1489596 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/LogAggregationService.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675939#comment-13675939 ] Hudson commented on YARN-742: - Integrated in Hadoop-Mapreduce-trunk #1447 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1447/]) YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe. (Revision 1489596) Result = SUCCESS kihwal : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1489596 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/LogAggregationService.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13674393#comment-13674393 ] Kihwal Lee commented on YARN-742: - +1 the patch looks good. Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675126#comment-13675126 ] Kihwal Lee commented on YARN-742: - There were other changes made in trunk so the patch doesn't apply any more. Please update the patch. Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[
https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675196#comment-13675196
]
Hadoop QA commented on YARN-742:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12586157/YARN-742-1.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/1112//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/1112//console
This message is automatically generated.
Log aggregation causes a lot of redundant setPermission calls
-
Key: YARN-742
URL: https://issues.apache.org/jira/browse/YARN-742
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 0.23.7, 2.0.4-alpha
Reporter: Kihwal Lee
Assignee: Jason Lowe
Attachments: YARN-742-1.patch, YARN-742.patch
In one of our clusters, namenode RPC is spending 45% of its time on serving
setPermission calls. Further investigation has revealed that most calls are
redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made
before this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675230#comment-13675230 ] Hudson commented on YARN-742: - Integrated in Hadoop-trunk-Commit #3858 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3858/]) YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe. (Revision 1489596) Result = SUCCESS kihwal : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1489596 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/LogAggregationService.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[ https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675262#comment-13675262 ] Kihwal Lee commented on YARN-742: - Jason, the test failed to merge in branch-0.23. Log aggregation causes a lot of redundant setPermission calls - Key: YARN-742 URL: https://issues.apache.org/jira/browse/YARN-742 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affects Versions: 0.23.7, 2.0.4-alpha Reporter: Kihwal Lee Assignee: Jason Lowe Attachments: YARN-742-1.patch, YARN-742.patch In one of our clusters, namenode RPC is spending 45% of its time on serving setPermission calls. Further investigation has revealed that most calls are redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made before this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[
https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675337#comment-13675337
]
Hadoop QA commented on YARN-742:
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12586204/YARN-742-1.branch-0.23.patch
against trunk revision .
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/1117//console
This message is automatically generated.
Log aggregation causes a lot of redundant setPermission calls
-
Key: YARN-742
URL: https://issues.apache.org/jira/browse/YARN-742
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 0.23.7, 2.0.4-alpha
Reporter: Kihwal Lee
Assignee: Jason Lowe
Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch,
YARN-742.patch
In one of our clusters, namenode RPC is spending 45% of its time on serving
setPermission calls. Further investigation has revealed that most calls are
redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made
before this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-742) Log aggregation causes a lot of redundant setPermission calls
[
https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673693#comment-13673693
]
Hadoop QA commented on YARN-742:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12585968/YARN-742.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/1086//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/1086//console
This message is automatically generated.
Log aggregation causes a lot of redundant setPermission calls
-
Key: YARN-742
URL: https://issues.apache.org/jira/browse/YARN-742
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Affects Versions: 0.23.7, 2.0.4-alpha
Reporter: Kihwal Lee
Assignee: Jason Lowe
Attachments: YARN-742.patch
In one of our clusters, namenode RPC is spending 45% of its time on serving
setPermission calls. Further investigation has revealed that most calls are
redundantly made on /mapred/logs/user/logs. Also mkdirs calls are made
before this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
