Can you send me the source to the test program? -ryan
On Wed, Jun 10, 2009 at 10:43 PM, Andrew Purtell (JIRA) <[email protected]>wrote: > > [ > https://issues.apache.org/jira/browse/HBASE-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718307#action_12718307] > > Andrew Purtell commented on HBASE-1500: > --------------------------------------- > > This is pretty basic breakage. I inserted a few 1000 rows of data keyed > with MD5 sums, then tried to run a count from the shell: > > {code} > count 'content' > 09/06/10 22:36:15 DEBUG client.HConnectionManager$TableServers: Cache hit > for ro > w <> in tableName content: location server 192.168.56.1:39961, location > region n > ame content,,1244694091453 > 09/06/10 22:36:15 DEBUG client.HConnectionManager$TableServers: Cache hit > for ro > w <> in tableName .META.: location server 192.168.56.1:39961, location > region na > me .META.,,1 > 09/06/10 22:36:15 DEBUG client.HTable$ClientScanner: Creating scanner over > conte > nt starting at key '' > 09/06/10 22:36:15 DEBUG client.HTable$ClientScanner: Advancing internal > scanner > to startKey at '' > 09/06/10 22:36:15 DEBUG client.HConnectionManager$TableServers: Cache hit > for ro > w <> in tableName content: location server 192.168.56.1:39961, location > region n > ame content,,1244694091453 > 09/06/10 22:36:17 DEBUG client.HConnectionManager$TableServers: address: > 192.168 > .56.1:39961, regioninfo: REGION => {NAME => 'content,,1244698495875', > STARTKEY = > > '', ENDKEY => '7f47a51d4f7a8c882288d86a4c5cdc3d', ENCODED => 1221125875, > TABLE > => {{NAME => 'content', FAMILIES => [{NAME => 'content', VERSIONS => '1', > COMPR > ESSION => 'GZ', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => > 'false', > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '1', COMPRESSION => > 'NONE' > , TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', > BLOCKCACHE => > 'false'}, {NAME => 'url', VERSIONS => '1', COMPRESSION => 'NONE', TTL => > '21474 > 83647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => > 'false'}]}} > Current count: 1000, row: 0a917eadf27f4917f1a823f085d1e4bd > > Current count: 2000, row: 156d46ad656a85f47e4e8d50c23167e9 > > Current count: 3000, row: 1fef03d4744e5252dee5f44c36f74a00 > > Current count: 4000, row: 2a8376e2718993eab5a7aa3cfc769e42 > > Current count: 5000, row: 34e566f2cd7eb35ea2d7ce6bc2312638 > > Current count: 6000, row: 3f68045f0aae18f432e0de665909f202 > > Current count: 7000, row: 49c514099448cfd9609445b37f5b161f > > Current count: 8000, row: 5476db74043ccf5e40cb7974e7c07c83 > > Current count: 9000, row: 5f3998658a477b7cbf806f4082643f2a > > Current count: 10000, row: 69fd32fcf76f64116602def18248938b > > Current count: 11000, row: 74be3000056b58b8b487c5243aadf02b > > Current count: 12000, row: 7ef67ca4c45a28d90847288300f05d4a > > Current count: 13000, row: 89783606fa73bcbf10a7b850bfa57877 > > Current count: 14000, row: 945c830a5eecd63e948e736deada42f3 > > Current count: 15000, row: 9f41e1454905fd7416f89aa4380a65e1 > > Current count: 16000, row: aa54517d0450127c90e4dd4631eaa010 > > Current count: 17000, row: b57b55373bf1302135dcefb044a58528 > > Current count: 18000, row: c06d66ca04ab273cc96f050ded843160 > > Current count: 19000, row: cb36f29c8d12098e25f007d7f658f495 > > Current count: 20000, row: d59d9e495fd2f983b302e67d94aa5962 > > Current count: 21000, row: e10430e1fda5ad363c72bb5ab7e7f8dd > > Current count: 22000, row: ec1d2d9cc89cd8ec67ffa1db1f3a7474 > > Current count: 23000, row: f73d7cb9759f556b94aad178e6a6e0d5 > > 09/06/10 22:37:24 DEBUG client.HTable$ClientScanner: Advancing forward from > regi > on REGION => {NAME => 'content,,1244698495875', STARTKEY => '', ENDKEY => > '7f47a > 51d4f7a8c882288d86a4c5cdc3d', ENCODED => 1221125875, TABLE => {{NAME => > 'content > ', FAMILIES => [{NAME => 'content', VERSIONS => '1', COMPRESSION => 'GZ', > TTL => > '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => > 'false' > }, {NAME => 'info', VERSIONS => '1', COMPRESSION => 'NONE', TTL => > '2147483647', > BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'false'}, {NAME > => 'u > rl', VERSIONS => '1', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE > => ' > 65536', IN_MEMORY => 'false', BLOCKCACHE => 'false'}]}} > 09/06/10 22:37:24 DEBUG client.HTable$ClientScanner: Advancing internal > scanner > to startKey at '7f47a51d4f7a8c882288d86a4c5cdc3d' > NativeException: java.lang.RuntimeException: > org.apache.hadoop.hbase.client.Retr > iesExhaustedException: Trying to contact region server null for region , > row '7f > 47a51d4f7a8c882288d86a4c5cdc3d', but failed after 5 attempts. > Exceptions: > java.lang.ArrayIndexOutOfBoundsException: 32 > java.lang.ArrayIndexOutOfBoundsException: 32 > java.lang.ArrayIndexOutOfBoundsException: 32 > java.lang.ArrayIndexOutOfBoundsException: 32 > java.lang.ArrayIndexOutOfBoundsException: 32 > from org/apache/hadoop/hbase/client/HTable.java:2002:in `hasNext' > from sun.reflect.GeneratedMethodAccessor2:-1:in `invoke' > from sun/reflect/DelegatingMethodAccessorImpl.java:25:in `invoke' > from java/lang/reflect/Method.java:597:in `invoke' > from org/jruby/javasupport/JavaMethod.java:298:in > `invokeWithExceptionHandling' > from org/jruby/javasupport/JavaMethod.java:259:in `invoke' > from org/jruby/java/invokers/InstanceMethodInvoker.java:36:in `call' > from org/jruby/runtime/callsite/CachingCallSite.java:70:in `call' > from org/jruby/ast/CallNoArgNode.java:61:in `interpret' > from org/jruby/ast/WhileNode.java:127:in `interpret' > from org/jruby/ast/NewlineNode.java:104:in `interpret' > from org/jruby/ast/BlockNode.java:71:in `interpret' > from > org/jruby/internal/runtime/methods/InterpretedMethod.java:163:in `call' > from org/jruby/internal/runtime/methods/DefaultMethod.java:144:in > `call' > from org/jruby/runtime/callsite/CachingCallSite.java:110:in `call' > from C_3a_/cygwin/opt/HBASE_minus_7e_1_dot_3/bin/hirb.rb:369:in > `method_ > _25$RUBY$count' > ... 106 levels... > from C_3a_/cygwin/opt/HBASE_minus_7e_1_dot_3/bin/hirb#start:-1:in > `call' > from org/jruby/internal/runtime/methods/DynamicMethod.java:226:in > `call' > from org/jruby/internal/runtime/methods/CompiledMethod.java:211:in > `call' > from org/jruby/internal/runtime/methods/CompiledMethod.java:71:in > `call' > from org/jruby/runtime/callsite/CachingCallSite.java:253:in > `cacheAndCall' > from org/jruby/runtime/callsite/CachingCallSite.java:72:in `call' > from C_3a_/cygwin/opt/HBASE_minus_7e_1_dot_3/bin/hirb.rb:450:in > `__file__' > from C_3a_/cygwin/opt/HBASE_minus_7e_1_dot_3/bin/hirb.rb:-1:in > `load' > from org/jruby/Ruby.java:577:in `runScript' > from org/jruby/Ruby.java:480:in `runNormally' > from org/jruby/Ruby.java:354:in `runFromMain' > from org/jruby/Main.java:229:in `run' > from org/jruby/Main.java:110:in `run' > from org/jruby/Main.java:94:in `main' > from C:\cygwin\opt\HBASE-~1.3\/bin/hirb.rb:369:in `count' > from (hbase):4 > {code} > > > KeyValue$KeyComparator array overrun > > ------------------------------------ > > > > Key: HBASE-1500 > > URL: https://issues.apache.org/jira/browse/HBASE-1500 > > Project: Hadoop HBase > > Issue Type: Bug > > Affects Versions: 0.20.0 > > Reporter: Andrew Purtell > > Priority: Blocker > > Fix For: 0.20.0 > > > > > > {code} > > 09/06/08 22:58:47 INFO zookeeper.ZooKeeper: Initiating client connection, > host=B > > OA03:2181,BOA02:2181,BOA01:2181,BOA04:2181 sessionTimeout=10000 > watcher=org.apac > > he.hadoop.hbase.zookeeper.watcherwrap...@518bf072 > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: > zookeeper.disableAutoWatchReset is > > false > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Attempting connection to > server BOA > > 04/172.20.3.231:2181 > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Priming connection to > java.nio.chan > > nels.SocketChannel[connected local=/172.20.3.232:40296 remote=BOA04/ > 172.20.3.231 > > :2181] > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Server connection successful > > 09/06/08 22:58:47 WARN mapred.JobClient: Use GenericOptionsParser for > parsing th > > e arguments. Applications should implement Tool for the same. > > 09/06/08 22:58:47 WARN mapred.JobClient: No job jar file set. User > classes may > > not be found. See JobConf(Class) or JobConf#setJar(String). > > 09/06/08 22:58:47 INFO zookeeper.ZooKeeper: Initiating client connection, > host=B > > OA03:2181,BOA02:2181,BOA01:2181,BOA04:2181 sessionTimeout=10000 > watcher=org.apac > > he.hadoop.hbase.zookeeper.watcherwrap...@362f0d54 > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Attempting connection to > server BOA > > 03/172.20.3.230:2181 > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Priming connection to > java.nio.chan > > nels.SocketChannel[connected local=/172.20.3.232:42792 remote=BOA03/ > 172.20.3.230 > > :2181] > > 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Server connection successful > > 09/06/08 22:58:48 INFO mapred.TableInputFormatBase: split: > 0->BOA04.trendmicro.c > > om:,01e33c601a7a9dd0ddb5c8427438f2f1 > > Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 32 > > at org.apache.hadoop.hbase.util.Bytes.compareTo(Bytes.java:798) > > at > org.apache.hadoop.hbase.KeyValue$KeyComparator.compareRows(KeyValue.j > > ava:1760) > > at > org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java: > > 1696) > > at > org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java: > > 1755) > > at > org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java: > > 1687) > > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getCac > > hedLocation(HConnectionManager.java:697) > > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locate > > RegionInMeta(HConnectionManager.java:541) > > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locate > > Region(HConnectionManager.java:525) > > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locate > > Region(HConnectionManager.java:488) > > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getReg > > ionLocation(HConnectionManager.java:342) > > at > org.apache.hadoop.hbase.client.HTable.getRegionLocation(HTable.java:1 > > 91) > > at > org.apache.hadoop.hbase.mapred.TableInputFormatBase.getSplits(TableIn > > putFormatBase.java:296) > > at > org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:742) > > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1026) > > at net.iridiant.crawler.mapred.DocumentParser.main(Unknown > Source) > > {code} > > -- > This message is automatically generated by JIRA. > - > You can reply to this email to add a comment to the issue online. > >
