[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988541#comment-13988541 ] Junping Du commented on HDFS-5580: -- Hi [~decster], TestBalancerWithNodeGroup failed again and trigger in HDFS-6250. Would you take a look at what's happen there? Thx! > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Fix For: 2.3.0 > > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845442#comment-13845442 ] Hudson commented on HDFS-5580: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1635/]) HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du) (junping_du: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1550074) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Fix For: 2.4.0 > > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845387#comment-13845387 ] Hudson commented on HDFS-5580: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1609/]) HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du) (junping_du: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1550074) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Fix For: 2.4.0 > > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845291#comment-13845291 ] Hudson commented on HDFS-5580: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/418/]) HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du) (junping_du: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1550074) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Fix For: 2.4.0 > > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845204#comment-13845204 ] Junping Du commented on HDFS-5580: -- +1. I have commit this to trunk and branch-2. Thanks Binglin! > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Fix For: 2.4.0 > > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845193#comment-13845193 ] Hudson commented on HDFS-5580: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4863 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4863/]) HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du) (junping_du: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1550074) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1.4#6159)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836620#comment-13836620 ] Binglin Chang commented on HDFS-5580: - I manually run the test 50 times, no timeout occurred, it's kind of hard to construct a test to reproduce a failing scenario. > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836343#comment-13836343 ] Hadoop QA commented on HDFS-5580: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12616504/HDFS-5580.v3.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/5605//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/5605//console This message is automatically generated. > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836333#comment-13836333 ] Junping Du commented on HDFS-5580: -- +1. v3 patch looks good to me. Thanks for fixing this. Binglin! > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > HDFS-5580.v3.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836153#comment-13836153 ] Junping Du commented on HDFS-5580: -- Thanks for working on this. Binglin! I will review your patch soon. btw, do you do some iterations (i.e. 50 times) to verify tests are not failed given this failure is occasional? > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13835138#comment-13835138 ] Hadoop QA commented on HDFS-5580: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12616319/HDFS-5580.v2.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/5601//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/5601//console This message is automatically generated. > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, HDFS-5580.v2.patch, > TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13834977#comment-13834977 ] Hadoop QA commented on HDFS-5580: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12616259/HDFS-5580.v1.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes org.apache.hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes org.apache.hadoop.hdfs.server.balancer.TestBalancer org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/5600//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/5600//console This message is automatically generated. > Infinite loop in Balancer.waitForMoveCompletion > --- > > Key: HDFS-5580 > URL: https://issues.apache.org/jira/browse/HDFS-5580 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Binglin Chang >Assignee: Binglin Chang > Attachments: HDFS-5580.v1.patch, TestBalancerWithNodeGroupTimeout.log > > > In recent > [build|https://builds.apache.org/job/PreCommit-HDFS-Build/5592//testReport/org.apache.hadoop.hdfs.server.balancer/TestBalancerWithNodeGroup/testBalancerWithNodeGroup/] > in HDFS-5574, TestBalancerWithNodeGroup timeout, this is also mentioned in > HDFS-4376 > [here|https://issues.apache.org/jira/browse/HDFS-4376?focusedCommentId=13799402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13799402]. > > Looks like the bug is introduced by HDFS-3495. -- This message was sent by Atlassian JIRA (v6.1#6144)