[jira] [Updated] (HBASE-5997) Fix concerns raised in HBASE-5922 related to HalfStoreFileReader
[ https://issues.apache.org/jira/browse/HBASE-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-5997: -- Status: Patch Available (was: Reopened) Fix concerns raised in HBASE-5922 related to HalfStoreFileReader Key: HBASE-5997 URL: https://issues.apache.org/jira/browse/HBASE-5997 Project: HBase Issue Type: Bug Affects Versions: 0.94.0, 0.92.1, 0.90.6, 0.96.0 Reporter: ramkrishna.s.vasudevan Assignee: Anoop Sam John Fix For: 0.96.0, 0.94.3 Attachments: 5997v3_trunk.txt, HBASE-5997_0.94.patch, HBASE-5997_94 V2.patch, HBASE-5997_94 V3.patch, Testcase.patch.txt Pls refer to the comment https://issues.apache.org/jira/browse/HBASE-5922?focusedCommentId=13269346page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13269346. Raised this issue to solve that comment. Just incase we don't forget it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442191#comment-13442191 ] Hudson commented on HBASE-6622: --- Integrated in HBase-TRUNK #3282 (See [https://builds.apache.org/job/HBase-TRUNK/3282/]) HBASE-6622 TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk (Revision 1377508) Result = FAILURE Tedyu : Files : * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/encoding/TestUpgradeFromHFileV1ToEncoding.java TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable {code} Looks like ROOT region
[jira] [Reopened] (HBASE-6477) Use PB filter definitions in RPC
[ https://issues.apache.org/jira/browse/HBASE-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-6477: --- I could no longer find TestAggregateProtocol in build console output. I tried to identify the hanging test and found the following in org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol-output.txt: {code} Sat Aug 25 19:27:36 PDT 2012, org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@382ce255, java.io.IOException: Can't write: {timeRange:[0,9223372036854775807],batch:-1,startRow:testRow\\x00\\x00\\x00\\x05,stopRow:testRow\\x00\\x00\\x00\\x0F,totalColumns:1,cacheBlocks:true,families:{TestFamily:[TestQualifier]},maxResultSize:-1,maxVersions:1,caching:-1} as class org.apache.hadoop.hbase.client.Scan Sat Aug 25 19:27:44 PDT 2012, org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@382ce255, java.io.IOException: Can't write: {timeRange:[0,9223372036854775807],batch:-1,startRow:testRow\\x00\\x00\\x00\\x05,stopRow:testRow\\x00\\x00\\x00\\x0F,totalColumns:1,cacheBlocks:true,families:{TestFamily:[TestQualifier]},maxResultSize:-1,maxVersions:1,caching:-1} as class org.apache.hadoop.hbase.client.Scan Sat Aug 25 19:28:00 PDT 2012, org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@382ce255, java.io.IOException: Can't write: {timeRange:[0,9223372036854775807],batch:-1,startRow:testRow\\x00\\x00\\x00\\x05,stopRow:testRow\\x00\\x00\\x00\\x0F,totalColumns:1,cacheBlocks:true,families:{TestFamily:[TestQualifier]},maxResultSize:-1,maxVersions:1,caching:-1} as class org.apache.hadoop.hbase.client.Scan at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) at java.util.concurrent.FutureTask.get(FutureTask.java:83) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processExecs(HConnectionManager.java:2206) at org.apache.hadoop.hbase.client.HTable.coprocessorExec(HTable.java:1351) at org.apache.hadoop.hbase.client.coprocessor.AggregationClient.getAvgArgs(AggregationClient.java:307) at org.apache.hadoop.hbase.client.coprocessor.AggregationClient.avg(AggregationClient.java:338) at org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol.testAvgWithValidRange2(TestAggregateProtocol.java:636) {code} The above came from this call in ProtobufUtil.toParameter(): {code} HbaseObjectWritable.writeObject(out, value, clz, null); {code} This is because Scan no longer implements Writable, due to this patch. Use PB filter definitions in RPC Key: HBASE-6477 URL: https://issues.apache.org/jira/browse/HBASE-6477 Project: HBase Issue Type: Task Components: ipc, migration Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.96.0 Attachments: HBASE-6477-nonrb.patch, HBASE-6477-nonrb-v3.patch, HBASE-6477-nonrb-v4.patch Use the filters introduced in HBASE-6454 in the rpc so they are extensible -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6477) Use PB filter definitions in RPC
[ https://issues.apache.org/jira/browse/HBASE-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442199#comment-13442199 ] Ted Yu commented on HBASE-6477: --- Here is the call stack: {code} HbaseObjectWritable.writeObject(DataOutput, Object, Class, Configuration) line: 547 ProtobufUtil.toParameter(Class?, Object) line: 1147 ProtobufUtil.toExec(Exec) line: 732 RequestConverter.buildExecCoprocessorRequest(byte[], Exec) line: 487 ProtobufUtil.execCoprocessor(ClientProtocol, Exec, byte[]) line: 1286 ExecRPCInvoker$1.call() line: 80 ExecRPCInvoker$1.call() line: 77 ExecRPCInvoker$1(ServerCallableT).withRetries() line: 169 ExecRPCInvoker.invoke(Object, Method, Object[]) line: 83 $Proxy25.getMedian(ColumnInterpreter, Scan) line: not available AggregationClient$7.call(AggregateProtocol) line: 465 AggregationClient$7.call(Object) line: 462 HConnectionManager$HConnectionImplementation$4.call() line: 2194 FutureTask$Sync.innerRun() line: 303 FutureTaskV.run() line: 138 ThreadPoolExecutor$Worker.runTask(Runnable) line: 886 ThreadPoolExecutor$Worker.run() line: 908 Thread.run() line: 680 {code} So as long as HbaseObjectWritable.writeObject() call is in our code base, migration away from Writable wouldn't be complete. w.r.t. Gregory's patch, we can either: 1. let Scan implement Writable 2. roll back so that we can have a green build Use PB filter definitions in RPC Key: HBASE-6477 URL: https://issues.apache.org/jira/browse/HBASE-6477 Project: HBase Issue Type: Task Components: ipc, migration Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.96.0 Attachments: HBASE-6477-nonrb.patch, HBASE-6477-nonrb-v3.patch, HBASE-6477-nonrb-v4.patch Use the filters introduced in HBASE-6454 in the rpc so they are extensible -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5449) Support for wire-compatible security functionality
[ https://issues.apache.org/jira/browse/HBASE-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442200#comment-13442200 ] Ted Yu commented on HBASE-5449: --- The above finding actually should go to HBASE-6477 Support for wire-compatible security functionality -- Key: HBASE-5449 URL: https://issues.apache.org/jira/browse/HBASE-5449 Project: HBase Issue Type: Sub-task Components: ipc, master, migration, regionserver Reporter: Todd Lipcon Assignee: Matteo Bertozzi Fix For: 0.96.0 Attachments: AccessControl_protos.patch, HBASE-5449-v0.patch, HBASE-5449-v1.patch, HBASE-5449-v2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6477) Use PB filter definitions in RPC
[ https://issues.apache.org/jira/browse/HBASE-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442207#comment-13442207 ] Ted Yu commented on HBASE-6477: --- This is Gregory's 1st goal: Filter would no longer extend Writable So option #1 above wouldn't work because Scan had this code: {code} if(in.readBoolean()) { this.filter = (Filter)createForName(Bytes.toString(Bytes.readByteArray(in))); this.filter.readFields(in); } {code} Use PB filter definitions in RPC Key: HBASE-6477 URL: https://issues.apache.org/jira/browse/HBASE-6477 Project: HBase Issue Type: Task Components: ipc, migration Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.96.0 Attachments: HBASE-6477-nonrb.patch, HBASE-6477-nonrb-v3.patch, HBASE-6477-nonrb-v4.patch Use the filters introduced in HBASE-6454 in the rpc so they are extensible -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5997) Fix concerns raised in HBASE-5922 related to HalfStoreFileReader
[ https://issues.apache.org/jira/browse/HBASE-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442208#comment-13442208 ] Ted Yu commented on HBASE-5997: --- Since I got some finding w.r.t. HBASE-6477, I am rerunning test suite without patch for 6477 but with trunk patch for this JIRA. Will report back whether the build passes. Fix concerns raised in HBASE-5922 related to HalfStoreFileReader Key: HBASE-5997 URL: https://issues.apache.org/jira/browse/HBASE-5997 Project: HBase Issue Type: Bug Affects Versions: 0.90.6, 0.92.1, 0.94.0, 0.96.0 Reporter: ramkrishna.s.vasudevan Assignee: Anoop Sam John Fix For: 0.96.0, 0.94.3 Attachments: 5997v3_trunk.txt, HBASE-5997_0.94.patch, HBASE-5997_94 V2.patch, HBASE-5997_94 V3.patch, Testcase.patch.txt Pls refer to the comment https://issues.apache.org/jira/browse/HBASE-5922?focusedCommentId=13269346page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13269346. Raised this issue to solve that comment. Just incase we don't forget it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6477) Use PB filter definitions in RPC
[ https://issues.apache.org/jira/browse/HBASE-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442209#comment-13442209 ] stack commented on HBASE-6477: -- I can work on a patch to fix above (Thanks for finding it Ted). I have to step out for moment so it'd be later. I'd rather keep this patch in at least for a day or so. Its a mammoth patch so some teething getting it all in is expected I'd say. Use PB filter definitions in RPC Key: HBASE-6477 URL: https://issues.apache.org/jira/browse/HBASE-6477 Project: HBase Issue Type: Task Components: ipc, migration Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.96.0 Attachments: HBASE-6477-nonrb.patch, HBASE-6477-nonrb-v3.patch, HBASE-6477-nonrb-v4.patch Use the filters introduced in HBASE-6454 in the rpc so they are extensible -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442210#comment-13442210 ] stack commented on HBASE-6622: -- +1 on patch. Does it need backporting? TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable {code} Looks like ROOT region couldn't be assigned. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442211#comment-13442211 ] stack commented on HBASE-6622: -- I'd say if the test is same in 0.94, upping the number of servers as is done in the patch would be good there too. TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable {code} Looks like ROOT region couldn't be assigned. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6667) TestCatalogJanitor occasionally fails
[ https://issues.apache.org/jira/browse/HBASE-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-6667: -- Priority: Critical (was: Major) TestCatalogJanitor occasionally fails - Key: HBASE-6667 URL: https://issues.apache.org/jira/browse/HBASE-6667 Project: HBase Issue Type: Bug Reporter: Ted Yu Priority: Critical Fix For: 0.96.0 Attachments: testCatalogJanitor-output.txt Here is the OS: Linux sea0 2.6.38-11-generic #48-Ubuntu SMP Fri Jul 29 19:02:55 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux {code} testArchiveOldRegion(org.apache.hadoop.hbase.master.TestCatalogJanitor) Time elapsed: 0.007 sec FAILURE! java.lang.AssertionError: Not the same number of current files Expected (2): Gotten (0): Not Found: _store0 _store1 Extra: at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.hadoop.hbase.util.HFileArchiveTestingUtil.assertArchiveEqualToOriginal(HFileArchiveTestingUtil.java:132) at org.apache.hadoop.hbase.util.HFileArchiveTestingUtil.assertArchiveEqualToOriginal(HFileArchiveTestingUtil.java:95) at org.apache.hadoop.hbase.master.TestCatalogJanitor.testArchiveOldRegion(TestCatalogJanitor.java:623) {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6667) TestCatalogJanitor occasionally fails
[ https://issues.apache.org/jira/browse/HBASE-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-6667: -- Attachment: testCatalogJanitor-output.txt Here is test output TestCatalogJanitor occasionally fails - Key: HBASE-6667 URL: https://issues.apache.org/jira/browse/HBASE-6667 Project: HBase Issue Type: Bug Reporter: Ted Yu Priority: Critical Fix For: 0.96.0 Attachments: testCatalogJanitor-output.txt Here is the OS: Linux sea0 2.6.38-11-generic #48-Ubuntu SMP Fri Jul 29 19:02:55 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux {code} testArchiveOldRegion(org.apache.hadoop.hbase.master.TestCatalogJanitor) Time elapsed: 0.007 sec FAILURE! java.lang.AssertionError: Not the same number of current files Expected (2): Gotten (0): Not Found: _store0 _store1 Extra: at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.hadoop.hbase.util.HFileArchiveTestingUtil.assertArchiveEqualToOriginal(HFileArchiveTestingUtil.java:132) at org.apache.hadoop.hbase.util.HFileArchiveTestingUtil.assertArchiveEqualToOriginal(HFileArchiveTestingUtil.java:95) at org.apache.hadoop.hbase.master.TestCatalogJanitor.testArchiveOldRegion(TestCatalogJanitor.java:623) {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-6667) TestCatalogJanitor occasionally fails
Ted Yu created HBASE-6667: - Summary: TestCatalogJanitor occasionally fails Key: HBASE-6667 URL: https://issues.apache.org/jira/browse/HBASE-6667 Project: HBase Issue Type: Bug Reporter: Ted Yu Fix For: 0.96.0 Attachments: testCatalogJanitor-output.txt Here is the OS: Linux sea0 2.6.38-11-generic #48-Ubuntu SMP Fri Jul 29 19:02:55 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux {code} testArchiveOldRegion(org.apache.hadoop.hbase.master.TestCatalogJanitor) Time elapsed: 0.007 sec FAILURE! java.lang.AssertionError: Not the same number of current files Expected (2): Gotten (0): Not Found: _store0 _store1 Extra: at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.hadoop.hbase.util.HFileArchiveTestingUtil.assertArchiveEqualToOriginal(HFileArchiveTestingUtil.java:132) at org.apache.hadoop.hbase.util.HFileArchiveTestingUtil.assertArchiveEqualToOriginal(HFileArchiveTestingUtil.java:95) at org.apache.hadoop.hbase.master.TestCatalogJanitor.testArchiveOldRegion(TestCatalogJanitor.java:623) {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5997) Fix concerns raised in HBASE-5922 related to HalfStoreFileReader
[ https://issues.apache.org/jira/browse/HBASE-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442218#comment-13442218 ] Ted Yu commented on HBASE-5997: --- Hit HBASE-6667 in the test run Fix concerns raised in HBASE-5922 related to HalfStoreFileReader Key: HBASE-5997 URL: https://issues.apache.org/jira/browse/HBASE-5997 Project: HBase Issue Type: Bug Affects Versions: 0.90.6, 0.92.1, 0.94.0, 0.96.0 Reporter: ramkrishna.s.vasudevan Assignee: Anoop Sam John Fix For: 0.96.0, 0.94.3 Attachments: 5997v3_trunk.txt, HBASE-5997_0.94.patch, HBASE-5997_94 V2.patch, HBASE-5997_94 V3.patch, Testcase.patch.txt Pls refer to the comment https://issues.apache.org/jira/browse/HBASE-5922?focusedCommentId=13269346page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13269346. Raised this issue to solve that comment. Just incase we don't forget it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6477) Use PB filter definitions in RPC
[ https://issues.apache.org/jira/browse/HBASE-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1344#comment-1344 ] Ted Yu commented on HBASE-6477: --- This is the important call in AggregationClient.getMedianArgs(): {code} return instance.getMedian(ci, scan); {code} which involves the following method defined in AggregateProtocol: {code} T, S ListS getMedian(ColumnInterpreterT, S ci, Scan scan) {code} To my understanding, we need to explicitly PB-fy AggregateProtocol. I believe there is a dependency on Gary's work for coprocessors. Correct me if I am wrong. Use PB filter definitions in RPC Key: HBASE-6477 URL: https://issues.apache.org/jira/browse/HBASE-6477 Project: HBase Issue Type: Task Components: ipc, migration Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.96.0 Attachments: HBASE-6477-nonrb.patch, HBASE-6477-nonrb-v3.patch, HBASE-6477-nonrb-v4.patch Use the filters introduced in HBASE-6454 in the rpc so they are extensible -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5922) HalfStoreFileReader seekBefore causes StackOverflowError
[ https://issues.apache.org/jira/browse/HBASE-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442227#comment-13442227 ] Hudson commented on HBASE-5922: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #150 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/150/]) HBASE-5997 Fix concerns raised in HBASE-5922 related to HalfStoreFileReader; REVERT (Revision 1377483) Result = FAILURE stack : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/HalfStoreFileReader.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java HalfStoreFileReader seekBefore causes StackOverflowError Key: HBASE-5922 URL: https://issues.apache.org/jira/browse/HBASE-5922 Project: HBase Issue Type: Bug Components: client, io Affects Versions: 0.90.0 Environment: HBase 0.90.4 Reporter: Nate Putnam Assignee: Nate Putnam Priority: Critical Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1 Attachments: 5922.092.txt, HBASE-5922.patch, HBASE-5922.patch, HBASE-5922.v2.patch, HBASE-5922.v3.patch, HBASE-5922.v4.patch Calling HRegionServer.getClosestRowBefore() can cause a stack overflow if the underlying store file is a reference and the row key is in the bottom. java.io.IOException: java.io.IOException: java.lang.StackOverflowError at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:990) at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:978) at org.apache.hadoop.hbase.regionserver.HRegionServer.getClosestRowBefore(HRegionServer.java:1651) at sun.reflect.GeneratedMethodAccessor174.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570) at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039) Caused by: java.lang.StackOverflowError at org.apache.hadoop.hbase.io.HalfStoreFileReader$1.seekBefore(HalfStoreFileReader.java:147) at org.apache.hadoop.hbase.io.HalfStoreFileReader$1.seekBefore(HalfStoreFileReader.java:149) at org.apache.hadoop.hbase.io.HalfStoreFileReader$1.seekBefore(HalfStoreFileReader.java:149) at org.apache.hadoop.hbase.io.HalfStoreFileReader$1.seekBefore(HalfStoreFileReader.java:149) at org.apache.hadoop.hbase.io.HalfStoreFileReader$1.seekBefore(HalfStoreFileReader.java:149) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5997) Fix concerns raised in HBASE-5922 related to HalfStoreFileReader
[ https://issues.apache.org/jira/browse/HBASE-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442226#comment-13442226 ] Hudson commented on HBASE-5997: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #150 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/150/]) HBASE-5997 Fix concerns raised in HBASE-5922 related to HalfStoreFileReader; REVERT (Revision 1377483) Result = FAILURE stack : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/HalfStoreFileReader.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java Fix concerns raised in HBASE-5922 related to HalfStoreFileReader Key: HBASE-5997 URL: https://issues.apache.org/jira/browse/HBASE-5997 Project: HBase Issue Type: Bug Affects Versions: 0.90.6, 0.92.1, 0.94.0, 0.96.0 Reporter: ramkrishna.s.vasudevan Assignee: Anoop Sam John Fix For: 0.96.0, 0.94.3 Attachments: 5997v3_trunk.txt, HBASE-5997_0.94.patch, HBASE-5997_94 V2.patch, HBASE-5997_94 V3.patch, Testcase.patch.txt Pls refer to the comment https://issues.apache.org/jira/browse/HBASE-5922?focusedCommentId=13269346page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13269346. Raised this issue to solve that comment. Just incase we don't forget it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442228#comment-13442228 ] Hudson commented on HBASE-6622: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #150 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/150/]) HBASE-6622 TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk (Revision 1377508) Result = FAILURE Tedyu : Files : * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/encoding/TestUpgradeFromHFileV1ToEncoding.java TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable
[jira] [Commented] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442233#comment-13442233 ] Ted Yu commented on HBASE-6622: --- Although I haven't identified the exact change in RPC in trunk that caused this issue to occur, I believe the timing is different in 0.94 such that there is no such issue. TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable {code} Looks like ROOT region couldn't be assigned. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442249#comment-13442249 ] stack commented on HBASE-6622: -- Grand. Resolving the issue given Ted's last comment that 0.94 doesn't seem to have this problem. We can backport later if it becomes an issue. TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable {code} Looks like ROOT region couldn't be assigned. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6622) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk
[ https://issues.apache.org/jira/browse/HBASE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-6622: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) TestUpgradeFromHFileV1ToEncoding#testUpgrade fails in trunk --- Key: HBASE-6622 URL: https://issues.apache.org/jira/browse/HBASE-6622 Project: HBase Issue Type: Bug Reporter: Zhihong Ted Yu Assignee: Zhihong Ted Yu Fix For: 0.96.0 Attachments: 6622-v2.txt, 6622-v2.txt TestUpgradeFromHFileV1ToEncoding started to fail since build #3242 Build #3246 was more recent one where it failed. {code} 2012-08-21 00:49:06,536 INFO [SplitLogWorker-vesta.apache.org,40294,1345510146310] regionserver.SplitLogWorker(135): SplitLogWorker vesta.apache.org,40294,1345510146310 starting 2012-08-21 00:49:06,537 INFO [RegionServer:0;vesta.apache.org,40294,1345510146310] regionserver.HRegionServer(2431): Registered RegionServer MXBean 2012-08-21 00:49:06,620 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1606): Failed assignment of -ROOT-,,0.70236052 to vesta.apache.org,40294,1345510146310, trying to assign elsewhere instead; retry=0 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:187) at $Proxy15.openRegion(Unknown Source) at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:500) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1587) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1256) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1226) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1221) at org.apache.hadoop.hbase.master.AssignmentManager.assignRoot(AssignmentManager.java:2103) at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:785) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:665) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:439) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1766) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1187) at org.apache.hadoop.hbase.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:178) ... 11 more 2012-08-21 00:49:06,621 INFO [Master:0;vesta.apache.org,60969,1345510146282] master.RegionStates(250): Region {NAME = '-ROOT-,,0', STARTKEY = '', ENDKEY = '', ENCODED = 70236052,} transitioned from {-ROOT-,,0.70236052 state=PENDING_OPEN, ts=1345510146520, server=vesta.apache.org,40294,1345510146310} to {-ROOT-,,0.70236052 state=OFFLINE, ts=1345510146621, server=null} 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1772): Can't move the region 70236052, there is no destination server available. 2012-08-21 00:49:06,621 WARN [Master:0;vesta.apache.org,60969,1345510146282] master.AssignmentManager(1618): Unable to find a viable location to assign region -ROOT-,,0.70236052 2012-08-21 00:50:06,406 DEBUG [Master:0;vesta.apache.org,60969,1345510146282.archivedHFileCleaner] cleaner.CleanerChore(145): Checking directory: hdfs://localhost:56237/user/hudson/hbase/.archive/UpgradeTable {code} Looks like ROOT region couldn't be assigned. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6537) Balancer compete with disable table will lead to cluster inconsistent
[ https://issues.apache.org/jira/browse/HBASE-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442254#comment-13442254 ] Zhou wenjian commented on HBASE-6537: - @Lars rajeshbabu. i found it unavailable to run hudson, i do not know why, so i just delete the 94 attach. I'll resubmit it if nesscery Balancer compete with disable table will lead to cluster inconsistent -- Key: HBASE-6537 URL: https://issues.apache.org/jira/browse/HBASE-6537 Project: HBase Issue Type: Bug Components: master Affects Versions: 0.94.0 Reporter: Zhou wenjian Assignee: Zhou wenjian Fix For: 0.94.2 Attachments: HBASE-6537-trunk.patch, HBASE-6537-trunk-v2.patch Appear in 94. trunk is ok for the issue Balancer will collect the regionplans to move(unassign and then assign). before unassign, disable table appears, after close the region in rs, master will delete the znode, romove region from RIT, and then clean the region from the online regions. During romoving region from RIT and cleaning out the region from the online regions. balancer begins to unassign, it will get a NotServingRegionException and if the table is disabling, it will deal with the state in master and delete the znode . However the table is disabled now, so the RIT and znode will remain. TimeoutMonitor draws a blank on it. It will hold back enabling the table or balancer unless restart -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-6668) disable in shell may make confused to user
Zhou wenjian created HBASE-6668: --- Summary: disable in shell may make confused to user Key: HBASE-6668 URL: https://issues.apache.org/jira/browse/HBASE-6668 Project: HBase Issue Type: Bug Components: shell Affects Versions: 0.94.1 Reporter: Zhou wenjian Assignee: Zhou wenjian Fix For: 0.94.2 hbase(main):002:0 disable 'logTable' 0 row(s) in 2.0910 seconds hbase(main):003:0 disable 'logTable' 0 row(s) in 0.0260 seconds and we can found table are disabled in log when disable first appears but when i disable it again the client just return seemed to be sucessful and I can not find any log described it in the log. look into the admin.rb, find below #-- # Disables a table def disable(table_name) tableExists(table_name) return if disabled?(table_name) @admin.disableTable(table_name) end that would confuse us when we found it disabled already but returns nothing -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6477) Use PB filter definitions in RPC
[ https://issues.apache.org/jira/browse/HBASE-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442257#comment-13442257 ] Gregory Chanan commented on HBASE-6477: --- Thanks for finding this, Ted. I wonder if we can make the Exec call pass the Scan as the protobuf'ed version rather than the Writable. I'll look at doing it that way. Use PB filter definitions in RPC Key: HBASE-6477 URL: https://issues.apache.org/jira/browse/HBASE-6477 Project: HBase Issue Type: Task Components: ipc, migration Reporter: Gregory Chanan Assignee: Gregory Chanan Fix For: 0.96.0 Attachments: HBASE-6477-nonrb.patch, HBASE-6477-nonrb-v3.patch, HBASE-6477-nonrb-v4.patch Use the filters introduced in HBASE-6454 in the rpc so they are extensible -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6668) disable in shell may make confused to user
[ https://issues.apache.org/jira/browse/HBASE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442259#comment-13442259 ] Zhou wenjian commented on HBASE-6668: - also appears in enable twice hbase(main):001:0 enable 'logTable' 0 row(s) in 1.4390 seconds hbase(main):002:0 enable 'logTable' 0 row(s) in 0.0150 seconds disable in shell may make confused to user --- Key: HBASE-6668 URL: https://issues.apache.org/jira/browse/HBASE-6668 Project: HBase Issue Type: Bug Components: shell Affects Versions: 0.94.1 Reporter: Zhou wenjian Assignee: Zhou wenjian Fix For: 0.94.2 hbase(main):002:0 disable 'logTable' 0 row(s) in 2.0910 seconds hbase(main):003:0 disable 'logTable' 0 row(s) in 0.0260 seconds and we can found table are disabled in log when disable first appears but when i disable it again the client just return seemed to be sucessful and I can not find any log described it in the log. look into the admin.rb, find below #-- # Disables a table def disable(table_name) tableExists(table_name) return if disabled?(table_name) @admin.disableTable(table_name) end that would confuse us when we found it disabled already but returns nothing -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6598) Combine Master Metrics into a single class.
[ https://issues.apache.org/jira/browse/HBASE-6598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442268#comment-13442268 ] Elliott Clark commented on HBASE-6598: -- In jmx it will be under: Hadoop - HBase - HRegionServer. The new metrics has context and jmx context. Context is used with the hadoop-metrics2.properties file to determine where to send mbean. The jmx context is where in jconsole data will be pushed. Combine Master Metrics into a single class. --- Key: HBASE-6598 URL: https://issues.apache.org/jira/browse/HBASE-6598 Project: HBase Issue Type: Sub-task Affects Versions: 0.96.0 Reporter: Elliott Clark Assignee: Elliott Clark Priority: Blocker Attachments: HBASE-6598-0.patch, HBASE-6598-1.patch, HBASE-6598-2.patch, HBASE-6598-3.patch Rather than an MBean and a dynamic source. Lets use just one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6618) Implement FuzzyRowFilter with ranges support
[ https://issues.apache.org/jira/browse/HBASE-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13442276#comment-13442276 ] Anil Gupta commented on HBASE-6618: --- Hi Alex, I am still unable to access the png file for the algorithm. Is there some problem with JIRA system? or Can you re-upload the image? Thanks, Thanks, Anil Gupta Software Engineer II, Intuit, Inc Implement FuzzyRowFilter with ranges support Key: HBASE-6618 URL: https://issues.apache.org/jira/browse/HBASE-6618 Project: HBase Issue Type: New Feature Components: filters Reporter: Alex Baranau Priority: Minor Attachments: HBASE-6618-algo-desc-bits.png, HBASE-6618-algo.patch Apart from current ability to specify fuzzy row filter e.g. for userId_actionId format as _0004 (where 0004 - actionId) it would be great to also have ability to specify the fuzzy range , e.g. _0004, ..., _0099. See initial discussion here: http://search-hadoop.com/m/WVLJdX0Z65 Note: currently it is possible to provide multiple fuzzy row rules to existing FuzzyRowFilter, but in case when the range is big (contains thousands of values) it is not efficient. Filter should perform efficient fast-forwarding during the scan (this is what distinguishes it from regex row filter). While such functionality may seem like a proper fit for custom filter (i.e. not including into standard filter set) it looks like the filter may be very re-useable. We may judge based on the implementation that will hopefully be added. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-6669) Add BigDecimalColumnInterpreter for doing aggregations using AggregationClient
Anil Gupta created HBASE-6669: - Summary: Add BigDecimalColumnInterpreter for doing aggregations using AggregationClient Key: HBASE-6669 URL: https://issues.apache.org/jira/browse/HBASE-6669 Project: HBase Issue Type: New Feature Components: client, coprocessors Reporter: Anil Gupta Priority: Minor I recently created a Class for doing aggregations(sum,min,max,std) on values stored as BigDecimal in HBase. I would like to commit the BigDecimalColumnInterpreter into HBase. Thanks, Anil Gupta Software Engineer II, Intuit, Inc -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6669) Add BigDecimalColumnInterpreter for doing aggregations using AggregationClient
[ https://issues.apache.org/jira/browse/HBASE-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anil Gupta updated HBASE-6669: -- Description: I recently created a Class for doing aggregations(sum,min,max,std) on values stored as BigDecimal in HBase. I would like to commit the BigDecimalColumnInterpreter into HBase. In my opinion this class can be used by a wide variety of users. Please let me know if its not appropriate to add this class in HBase. Thanks, Anil Gupta Software Engineer II, Intuit, Inc was: I recently created a Class for doing aggregations(sum,min,max,std) on values stored as BigDecimal in HBase. I would like to commit the BigDecimalColumnInterpreter into HBase. Thanks, Anil Gupta Software Engineer II, Intuit, Inc Add BigDecimalColumnInterpreter for doing aggregations using AggregationClient -- Key: HBASE-6669 URL: https://issues.apache.org/jira/browse/HBASE-6669 Project: HBase Issue Type: New Feature Components: client, coprocessors Reporter: Anil Gupta Priority: Minor Labels: client, coprocessors I recently created a Class for doing aggregations(sum,min,max,std) on values stored as BigDecimal in HBase. I would like to commit the BigDecimalColumnInterpreter into HBase. In my opinion this class can be used by a wide variety of users. Please let me know if its not appropriate to add this class in HBase. Thanks, Anil Gupta Software Engineer II, Intuit, Inc -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira