[jira] [Commented] (HBASE-6958) TestAssignmentManager sometimes fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13474386#comment-13474386 ] Jimmy Xiang commented on HBASE-6958: With the patch(v4) for HBASE-6611, I ran the test 20+ times and didn't see the issue. Here is my env: Apache Maven 3.0.3 (r1075438; 2011-02-28 09:31:09-0800) Maven home: /etc/vendor/apache-maven-3.0.3 Java version: 1.7.0_07, vendor: Oracle Corporation Java home: /etc/vendor/jdk1.7.0_07/jre Default locale: en_US, platform encoding: UTF-8 OS name: linux, version: 3.0.0-14-generic, arch: amd64, family: unix Here is the command I used: mvn -DcompileSource=1.7 -PlocalTests clean test -Dtest=TestAssignmentManager TestAssignmentManager sometimes fails in trunk -- Key: HBASE-6958 URL: https://issues.apache.org/jira/browse/HBASE-6958 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 From https://builds.apache.org/job/HBase-TRUNK/3432/testReport/junit/org.apache.hadoop.hbase.master/TestAssignmentManager/testBalanceOnMasterFailoverScenarioWithOpenedNode/ : {code} Stacktrace java.lang.Exception: test timed out after 5000 milliseconds at java.lang.System.arraycopy(Native Method) at java.lang.ThreadGroup.remove(ThreadGroup.java:969) at java.lang.ThreadGroup.threadTerminated(ThreadGroup.java:942) at java.lang.Thread.exit(Thread.java:732) ... 2012-10-06 00:46:12,521 DEBUG [MASTER_CLOSE_REGION-mockedAMExecutor-0] zookeeper.ZKUtil(1141): mockedServer-0x13a33892de7000e Retrieved 81 byte(s) of data from znode /hbase/unassigned/dc01abf9cd7fd0ea256af4df02811640 and set watcher; region=t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640., state=M_ZK_REGION_OFFLINE, servername=master,1,1, createTime=1349484372509, payload.length=0 2012-10-06 00:46:12,522 ERROR [MASTER_CLOSE_REGION-mockedAMExecutor-0] executor.EventHandler(205): Caught throwable while processing event RS_ZK_REGION_CLOSED java.lang.NullPointerException at org.apache.hadoop.hbase.master.TestAssignmentManager$MockedLoadBalancer.randomAssignment(TestAssignmentManager.java:773) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1709) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1666) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1435) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1155) at org.apache.hadoop.hbase.master.TestAssignmentManager$AssignmentManagerWithExtrasForTesting.assign(TestAssignmentManager.java:1035) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1130) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1125) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2012-10-06 00:46:12,522 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(670): Handling transition=M_ZK_REGION_OFFLINE, server=master,1,1, region=dc01abf9cd7fd0ea256af4df02811640, current state from region state map ={t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640. state=OFFLINE, ts=1349484372508, server=null} {code} Looks like NPE happened on this line: {code} this.gate.set(true); {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6958) TestAssignmentManager sometimes fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473387#comment-13473387 ] ramkrishna.s.vasudevan commented on HBASE-6958: --- I was looking thro this. As per the failing testcase it should not use the MockLoadBalancer itself. Strange. But the reason could be MockLoadBalancer is not reverted back to normal balancer in one of the testcase which uses MockLoadBalancer. Added to that i was not able to reproduce the issue in my machine. TestAssignmentManager sometimes fails in trunk -- Key: HBASE-6958 URL: https://issues.apache.org/jira/browse/HBASE-6958 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 From https://builds.apache.org/job/HBase-TRUNK/3432/testReport/junit/org.apache.hadoop.hbase.master/TestAssignmentManager/testBalanceOnMasterFailoverScenarioWithOpenedNode/ : {code} Stacktrace java.lang.Exception: test timed out after 5000 milliseconds at java.lang.System.arraycopy(Native Method) at java.lang.ThreadGroup.remove(ThreadGroup.java:969) at java.lang.ThreadGroup.threadTerminated(ThreadGroup.java:942) at java.lang.Thread.exit(Thread.java:732) ... 2012-10-06 00:46:12,521 DEBUG [MASTER_CLOSE_REGION-mockedAMExecutor-0] zookeeper.ZKUtil(1141): mockedServer-0x13a33892de7000e Retrieved 81 byte(s) of data from znode /hbase/unassigned/dc01abf9cd7fd0ea256af4df02811640 and set watcher; region=t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640., state=M_ZK_REGION_OFFLINE, servername=master,1,1, createTime=1349484372509, payload.length=0 2012-10-06 00:46:12,522 ERROR [MASTER_CLOSE_REGION-mockedAMExecutor-0] executor.EventHandler(205): Caught throwable while processing event RS_ZK_REGION_CLOSED java.lang.NullPointerException at org.apache.hadoop.hbase.master.TestAssignmentManager$MockedLoadBalancer.randomAssignment(TestAssignmentManager.java:773) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1709) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1666) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1435) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1155) at org.apache.hadoop.hbase.master.TestAssignmentManager$AssignmentManagerWithExtrasForTesting.assign(TestAssignmentManager.java:1035) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1130) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1125) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2012-10-06 00:46:12,522 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(670): Handling transition=M_ZK_REGION_OFFLINE, server=master,1,1, region=dc01abf9cd7fd0ea256af4df02811640, current state from region state map ={t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640. state=OFFLINE, ts=1349484372508, server=null} {code} Looks like NPE happened on this line: {code} this.gate.set(true); {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6958) TestAssignmentManager sometimes fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473414#comment-13473414 ] Jimmy Xiang commented on HBASE-6958: I am working on HBASE-6611, and very close to post a new patch (early next week most likely), which will change this test a little bit. We can check if the issue is still there with that patch. TestAssignmentManager sometimes fails in trunk -- Key: HBASE-6958 URL: https://issues.apache.org/jira/browse/HBASE-6958 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 From https://builds.apache.org/job/HBase-TRUNK/3432/testReport/junit/org.apache.hadoop.hbase.master/TestAssignmentManager/testBalanceOnMasterFailoverScenarioWithOpenedNode/ : {code} Stacktrace java.lang.Exception: test timed out after 5000 milliseconds at java.lang.System.arraycopy(Native Method) at java.lang.ThreadGroup.remove(ThreadGroup.java:969) at java.lang.ThreadGroup.threadTerminated(ThreadGroup.java:942) at java.lang.Thread.exit(Thread.java:732) ... 2012-10-06 00:46:12,521 DEBUG [MASTER_CLOSE_REGION-mockedAMExecutor-0] zookeeper.ZKUtil(1141): mockedServer-0x13a33892de7000e Retrieved 81 byte(s) of data from znode /hbase/unassigned/dc01abf9cd7fd0ea256af4df02811640 and set watcher; region=t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640., state=M_ZK_REGION_OFFLINE, servername=master,1,1, createTime=1349484372509, payload.length=0 2012-10-06 00:46:12,522 ERROR [MASTER_CLOSE_REGION-mockedAMExecutor-0] executor.EventHandler(205): Caught throwable while processing event RS_ZK_REGION_CLOSED java.lang.NullPointerException at org.apache.hadoop.hbase.master.TestAssignmentManager$MockedLoadBalancer.randomAssignment(TestAssignmentManager.java:773) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1709) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1666) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1435) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1155) at org.apache.hadoop.hbase.master.TestAssignmentManager$AssignmentManagerWithExtrasForTesting.assign(TestAssignmentManager.java:1035) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1130) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1125) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2012-10-06 00:46:12,522 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(670): Handling transition=M_ZK_REGION_OFFLINE, server=master,1,1, region=dc01abf9cd7fd0ea256af4df02811640, current state from region state map ={t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640. state=OFFLINE, ts=1349484372508, server=null} {code} Looks like NPE happened on this line: {code} this.gate.set(true); {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6958) TestAssignmentManager sometimes fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472751#comment-13472751 ] stack commented on HBASE-6958: -- Any chance of a patch Ted? TestAssignmentManager sometimes fails in trunk -- Key: HBASE-6958 URL: https://issues.apache.org/jira/browse/HBASE-6958 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 From https://builds.apache.org/job/HBase-TRUNK/3432/testReport/junit/org.apache.hadoop.hbase.master/TestAssignmentManager/testBalanceOnMasterFailoverScenarioWithOpenedNode/ : {code} Stacktrace java.lang.Exception: test timed out after 5000 milliseconds at java.lang.System.arraycopy(Native Method) at java.lang.ThreadGroup.remove(ThreadGroup.java:969) at java.lang.ThreadGroup.threadTerminated(ThreadGroup.java:942) at java.lang.Thread.exit(Thread.java:732) ... 2012-10-06 00:46:12,521 DEBUG [MASTER_CLOSE_REGION-mockedAMExecutor-0] zookeeper.ZKUtil(1141): mockedServer-0x13a33892de7000e Retrieved 81 byte(s) of data from znode /hbase/unassigned/dc01abf9cd7fd0ea256af4df02811640 and set watcher; region=t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640., state=M_ZK_REGION_OFFLINE, servername=master,1,1, createTime=1349484372509, payload.length=0 2012-10-06 00:46:12,522 ERROR [MASTER_CLOSE_REGION-mockedAMExecutor-0] executor.EventHandler(205): Caught throwable while processing event RS_ZK_REGION_CLOSED java.lang.NullPointerException at org.apache.hadoop.hbase.master.TestAssignmentManager$MockedLoadBalancer.randomAssignment(TestAssignmentManager.java:773) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1709) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1666) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1435) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1155) at org.apache.hadoop.hbase.master.TestAssignmentManager$AssignmentManagerWithExtrasForTesting.assign(TestAssignmentManager.java:1035) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1130) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1125) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2012-10-06 00:46:12,522 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(670): Handling transition=M_ZK_REGION_OFFLINE, server=master,1,1, region=dc01abf9cd7fd0ea256af4df02811640, current state from region state map ={t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640. state=OFFLINE, ts=1349484372508, server=null} {code} Looks like NPE happened on this line: {code} this.gate.set(true); {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6958) TestAssignmentManager sometimes fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472792#comment-13472792 ] Jimmy Xiang commented on HBASE-6958: I can take a look next week if it is not urgent. TestAssignmentManager sometimes fails in trunk -- Key: HBASE-6958 URL: https://issues.apache.org/jira/browse/HBASE-6958 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 From https://builds.apache.org/job/HBase-TRUNK/3432/testReport/junit/org.apache.hadoop.hbase.master/TestAssignmentManager/testBalanceOnMasterFailoverScenarioWithOpenedNode/ : {code} Stacktrace java.lang.Exception: test timed out after 5000 milliseconds at java.lang.System.arraycopy(Native Method) at java.lang.ThreadGroup.remove(ThreadGroup.java:969) at java.lang.ThreadGroup.threadTerminated(ThreadGroup.java:942) at java.lang.Thread.exit(Thread.java:732) ... 2012-10-06 00:46:12,521 DEBUG [MASTER_CLOSE_REGION-mockedAMExecutor-0] zookeeper.ZKUtil(1141): mockedServer-0x13a33892de7000e Retrieved 81 byte(s) of data from znode /hbase/unassigned/dc01abf9cd7fd0ea256af4df02811640 and set watcher; region=t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640., state=M_ZK_REGION_OFFLINE, servername=master,1,1, createTime=1349484372509, payload.length=0 2012-10-06 00:46:12,522 ERROR [MASTER_CLOSE_REGION-mockedAMExecutor-0] executor.EventHandler(205): Caught throwable while processing event RS_ZK_REGION_CLOSED java.lang.NullPointerException at org.apache.hadoop.hbase.master.TestAssignmentManager$MockedLoadBalancer.randomAssignment(TestAssignmentManager.java:773) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1709) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1666) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1435) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1155) at org.apache.hadoop.hbase.master.TestAssignmentManager$AssignmentManagerWithExtrasForTesting.assign(TestAssignmentManager.java:1035) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1130) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1125) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2012-10-06 00:46:12,522 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(670): Handling transition=M_ZK_REGION_OFFLINE, server=master,1,1, region=dc01abf9cd7fd0ea256af4df02811640, current state from region state map ={t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640. state=OFFLINE, ts=1349484372508, server=null} {code} Looks like NPE happened on this line: {code} this.gate.set(true); {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6958) TestAssignmentManager sometimes fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13470884#comment-13470884 ] Ted Yu commented on HBASE-6958: --- Here is my environment: Darwin L0032 11.4.2 Darwin Kernel Version 11.4.2: Thu Aug 23 16:25:48 PDT 2012; root:xnu-1699.32.7~1/RELEASE_X86_64 x86_64 java version 1.7.0_07 Java(TM) SE Runtime Environment (build 1.7.0_07-b10) Java HotSpot(TM) 64-Bit Server VM (build 23.3-b01, mixed mode) TestAssignmentManager sometimes fails in trunk -- Key: HBASE-6958 URL: https://issues.apache.org/jira/browse/HBASE-6958 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 From https://builds.apache.org/job/HBase-TRUNK/3432/testReport/junit/org.apache.hadoop.hbase.master/TestAssignmentManager/testBalanceOnMasterFailoverScenarioWithOpenedNode/ : {code} Stacktrace java.lang.Exception: test timed out after 5000 milliseconds at java.lang.System.arraycopy(Native Method) at java.lang.ThreadGroup.remove(ThreadGroup.java:969) at java.lang.ThreadGroup.threadTerminated(ThreadGroup.java:942) at java.lang.Thread.exit(Thread.java:732) ... 2012-10-06 00:46:12,521 DEBUG [MASTER_CLOSE_REGION-mockedAMExecutor-0] zookeeper.ZKUtil(1141): mockedServer-0x13a33892de7000e Retrieved 81 byte(s) of data from znode /hbase/unassigned/dc01abf9cd7fd0ea256af4df02811640 and set watcher; region=t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640., state=M_ZK_REGION_OFFLINE, servername=master,1,1, createTime=1349484372509, payload.length=0 2012-10-06 00:46:12,522 ERROR [MASTER_CLOSE_REGION-mockedAMExecutor-0] executor.EventHandler(205): Caught throwable while processing event RS_ZK_REGION_CLOSED java.lang.NullPointerException at org.apache.hadoop.hbase.master.TestAssignmentManager$MockedLoadBalancer.randomAssignment(TestAssignmentManager.java:773) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1709) at org.apache.hadoop.hbase.master.AssignmentManager.getRegionPlan(AssignmentManager.java:1666) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1435) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1155) at org.apache.hadoop.hbase.master.TestAssignmentManager$AssignmentManagerWithExtrasForTesting.assign(TestAssignmentManager.java:1035) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1130) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1125) at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:106) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2012-10-06 00:46:12,522 DEBUG [pool-1-thread-1-EventThread] master.AssignmentManager(670): Handling transition=M_ZK_REGION_OFFLINE, server=master,1,1, region=dc01abf9cd7fd0ea256af4df02811640, current state from region state map ={t,,1349484359011.dc01abf9cd7fd0ea256af4df02811640. state=OFFLINE, ts=1349484372508, server=null} {code} Looks like NPE happened on this line: {code} this.gate.set(true); {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira