[jira] [Commented] (HBASE-21563) HBase Get Encounters java.lang.IndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HBASE-21563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989262#comment-16989262
]
William Shen commented on HBASE-21563:
--
[~openinx] did you ever find out if there's an issue with FastDiff? Thanks for
looking into this issue, and sorry for bumping up an old ticket.
> HBase Get Encounters java.lang.IndexOutOfBoundsException
>
>
> Key: HBASE-21563
> URL: https://issues.apache.org/jira/browse/HBASE-21563
> Project: HBase
> Issue Type: Bug
> Components: HFile
>Affects Versions: 1.2.0
>Reporter: William Shen
>Assignee: Zheng Hu
>Priority: Major
> Attachments: 67a04bc049be4f58afecdcc0a3ba62ca.tar.gz
>
>
> We've recently encountered issue retrieving data from our HBase cluster, and
> have not had much luck troubleshooting the issue. We narrowed down our issue
> to a single GET, which appears to be caused by FastDiffDeltaEncoder.java
> running into java.lang.IndexOutOfBoundsException.
> Perhaps there is a bug on a corner case for FastDiffDeltaEncoder?
> We are running 1.2.0-cdh5.9.2, and the GET in question is:
> {noformat}
> hbase(main):004:0> get 'qa2.ADGROUPS',
> "\x05\x80\x00\x00\x00\x00\x1F\x54\x9C\x80\x00\x00\x00\x00\x1C\x7D\x45\x00\x04\x80\x00\x00\x00\x00\x1D\x0F\x19\x80\x00\x00\x00\x00\x4A\x64\x6F\x80\x00\x00\x00\x01\xD9\xDB\xCE"
> COLUMNCELL
>
>
> ERROR: java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2215)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:185)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:165)
> Caused by: java.lang.IndexOutOfBoundsException
> at java.nio.Buffer.checkBounds(Buffer.java:567)
> at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:149)
> at
> org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decode(FastDiffDeltaEncoder.java:465)
> at
> org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decodeNext(FastDiffDeltaEncoder.java:516)
> at
> org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$BufferedEncodedSeeker.next(BufferedDataBlockEncoder.java:618)
> at
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.next(HFileReaderV2.java:1277)
> at
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:180)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:588)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:147)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:5706)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:5865)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5643)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5620)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5606)
> at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6801)
> at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6779)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2029)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33644)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> ... 3 more {noformat}
> Likewise, running {{ hbase hfile -f -p }} on the specific hfile, a subset of
> kv pairs were printed until the program hits the following exception and
> crashes:
> {noformat}
> Exception in thread "main" java.lang.RuntimeException: Unknown code 65
> at org.apache.hadoop.hbase.KeyValue$Type.codeToType(KeyValue.java:259)
> at org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:1246)
> at
> org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$ClonedSeekerState.toString(BufferedDataBlockEncoder.java:506)
> at java.lang.String.valueOf(String.java:2994)
> at java.lang.StringBuilder.append(StringBuilder.java:131)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.scanKeysValues(HFilePrettyPrinter.java:382)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.processFile(HFilePrettyPrinter.java:316)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.run(HFilePrettyPrinter.java:255)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
>
[jira] [Commented] (HBASE-22446) Advisory for devs on closing issues
[ https://issues.apache.org/jira/browse/HBASE-22446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844384#comment-16844384 ] William Shen commented on HBASE-22446: -- [~stack] - what do you think about adopting something similar to https://spark.apache.org/contributing.html (section Contributing to JIRA Maintenance)? > Advisory for devs on closing issues > --- > > Key: HBASE-22446 > URL: https://issues.apache.org/jira/browse/HBASE-22446 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: stack >Priority: Trivial > > Good info in ML dev thread subject 'Closing old JIRA tickets?' This issue is > about getting a distillation up into the refguide as start on a section on > closing-out JIRA tickets -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-22255) Process for gaining access to slack and mailing lists
[ https://issues.apache.org/jira/browse/HBASE-22255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Shen updated HBASE-22255: - Issue Type: Task (was: Bug) > Process for gaining access to slack and mailing lists > - > > Key: HBASE-22255 > URL: https://issues.apache.org/jira/browse/HBASE-22255 > Project: HBase > Issue Type: Task >Reporter: Evelina Dumitrescu >Assignee: William Shen >Priority: Trivial > > Hello, > > In the getting started documentation it is written to email the dev list in > order to get access to the slack channel. > Unfortunately, as a new user I didn't manage to send the email to the dev and > user lists. I checked the mailing lists archive and I couldn't find my emails > there. > What is the procedure for gaining access to the slack and mailing lists in > order to start making contributions? > > Thank you, > Evelina -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HBASE-22255) Process for gaining access to slack and mailing lists
[ https://issues.apache.org/jira/browse/HBASE-22255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Shen updated HBASE-22255: - Priority: Trivial (was: Major) > Process for gaining access to slack and mailing lists > - > > Key: HBASE-22255 > URL: https://issues.apache.org/jira/browse/HBASE-22255 > Project: HBase > Issue Type: Bug >Reporter: Evelina Dumitrescu >Assignee: William Shen >Priority: Trivial > > Hello, > > In the getting started documentation it is written to email the dev list in > order to get access to the slack channel. > Unfortunately, as a new user I didn't manage to send the email to the dev and > user lists. I checked the mailing lists archive and I couldn't find my emails > there. > What is the procedure for gaining access to the slack and mailing lists in > order to start making contributions? > > Thank you, > Evelina -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HBASE-22255) Process for gaining access to slack and mailing lists
[ https://issues.apache.org/jira/browse/HBASE-22255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Shen resolved HBASE-22255. -- Resolution: Done Assignee: William Shen [~evelinad], I've invited to the slack channel, and your email did get send out to the lists correctly. > Process for gaining access to slack and mailing lists > - > > Key: HBASE-22255 > URL: https://issues.apache.org/jira/browse/HBASE-22255 > Project: HBase > Issue Type: Bug >Reporter: Evelina Dumitrescu >Assignee: William Shen >Priority: Major > > Hello, > > In the getting started documentation it is written to email the dev list in > order to get access to the slack channel. > Unfortunately, as a new user I didn't manage to send the email to the dev and > user lists. I checked the mailing lists archive and I couldn't find my emails > there. > What is the procedure for gaining access to the slack and mailing lists in > order to start making contributions? > > Thank you, > Evelina -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-22092) Typo in block cache monitoring documentation
[
https://issues.apache.org/jira/browse/HBASE-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807005#comment-16807005
]
William Shen commented on HBASE-22092:
--
Thanks [~stack]. Will keep squashing in mind next time!
> Typo in block cache monitoring documentation
>
>
> Key: HBASE-22092
> URL: https://issues.apache.org/jira/browse/HBASE-22092
> Project: HBase
> Issue Type: Bug
> Components: documentation
>Reporter: William Shen
>Assignee: William Shen
>Priority: Trivial
> Fix For: 3.0.0
>
> Attachments: HBASE-22092.patch, HBASE-22092v2.patch
>
>
> In http://hbase.apache.org/book.html#_block_cache_monitoring, there's an
> incomplete sentence:
> {quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
> monitor and report on the performance of the block cache. To view the block
> cache reports, click .{quote}
> The old verbiage was:
> {quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
> monitor and report on the performance of the block cache. To view the block
> cache reports, click Tasks → Show Non-RPC Tasks → Block Cache. {quote}
> The old documentation seems incorrect also, and probably would be more
> appropriately worded along the line of {quote}To view the block cache
> reports, see the Block Cache section of the Region Server UI.{quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HBASE-22092) Typo in block cache monitoring documentation
[
https://issues.apache.org/jira/browse/HBASE-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Shen updated HBASE-22092:
-
Attachment: HBASE-22092v2.patch
> Typo in block cache monitoring documentation
>
>
> Key: HBASE-22092
> URL: https://issues.apache.org/jira/browse/HBASE-22092
> Project: HBase
> Issue Type: Bug
> Components: documentation
>Reporter: William Shen
>Priority: Trivial
> Attachments: HBASE-22092.patch, HBASE-22092v2.patch
>
>
> In http://hbase.apache.org/book.html#_block_cache_monitoring, there's an
> incomplete sentence:
> {quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
> monitor and report on the performance of the block cache. To view the block
> cache reports, click .{quote}
> The old verbiage was:
> {quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
> monitor and report on the performance of the block cache. To view the block
> cache reports, click Tasks → Show Non-RPC Tasks → Block Cache. {quote}
> The old documentation seems incorrect also, and probably would be more
> appropriately worded along the line of {quote}To view the block cache
> reports, see the Block Cache section of the Region Server UI.{quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HBASE-22092) Typo in block cache monitoring documentation
[
https://issues.apache.org/jira/browse/HBASE-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Shen updated HBASE-22092:
-
Attachment: HBASE-22092.patch
Status: Patch Available (was: Open)
Attaching patch to fix the incomplete sentence and also to bring back show
descriptions of reports previously available.
> Typo in block cache monitoring documentation
>
>
> Key: HBASE-22092
> URL: https://issues.apache.org/jira/browse/HBASE-22092
> Project: HBase
> Issue Type: Bug
> Components: documentation
>Reporter: William Shen
>Priority: Trivial
> Attachments: HBASE-22092.patch
>
>
> In http://hbase.apache.org/book.html#_block_cache_monitoring, there's an
> incomplete sentence:
> {quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
> monitor and report on the performance of the block cache. To view the block
> cache reports, click .{quote}
> The old verbiage was:
> {quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
> monitor and report on the performance of the block cache. To view the block
> cache reports, click Tasks → Show Non-RPC Tasks → Block Cache. {quote}
> The old documentation seems incorrect also, and probably would be more
> appropriately worded along the line of {quote}To view the block cache
> reports, see the Block Cache section of the Region Server UI.{quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HBASE-22092) Typo in block cache monitoring documentation
William Shen created HBASE-22092:
Summary: Typo in block cache monitoring documentation
Key: HBASE-22092
URL: https://issues.apache.org/jira/browse/HBASE-22092
Project: HBase
Issue Type: Bug
Components: documentation
Reporter: William Shen
In http://hbase.apache.org/book.html#_block_cache_monitoring, there's an
incomplete sentence:
{quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
monitor and report on the performance of the block cache. To view the block
cache reports, click .{quote}
The old verbiage was:
{quote}Starting with HBase 0.98, the HBase Web UI includes the ability to
monitor and report on the performance of the block cache. To view the block
cache reports, click Tasks → Show Non-RPC Tasks → Block Cache. {quote}
The old documentation seems incorrect also, and probably would be more
appropriately worded along the line of {quote}To view the block cache reports,
see the Block Cache section of the Region Server UI.{quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21563) HBase Get Encounters java.lang.IndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HBASE-21563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792944#comment-16792944
]
William Shen commented on HBASE-21563:
--
[~tigren], were you able to recover existing data?
> HBase Get Encounters java.lang.IndexOutOfBoundsException
>
>
> Key: HBASE-21563
> URL: https://issues.apache.org/jira/browse/HBASE-21563
> Project: HBase
> Issue Type: Bug
> Components: HFile
>Affects Versions: 1.2.0
>Reporter: William Shen
>Assignee: Zheng Hu
>Priority: Major
> Attachments: 67a04bc049be4f58afecdcc0a3ba62ca.tar.gz
>
>
> We've recently encountered issue retrieving data from our HBase cluster, and
> have not had much luck troubleshooting the issue. We narrowed down our issue
> to a single GET, which appears to be caused by FastDiffDeltaEncoder.java
> running into java.lang.IndexOutOfBoundsException.
> Perhaps there is a bug on a corner case for FastDiffDeltaEncoder?
> We are running 1.2.0-cdh5.9.2, and the GET in question is:
> {noformat}
> hbase(main):004:0> get 'qa2.ADGROUPS',
> "\x05\x80\x00\x00\x00\x00\x1F\x54\x9C\x80\x00\x00\x00\x00\x1C\x7D\x45\x00\x04\x80\x00\x00\x00\x00\x1D\x0F\x19\x80\x00\x00\x00\x00\x4A\x64\x6F\x80\x00\x00\x00\x01\xD9\xDB\xCE"
> COLUMNCELL
>
>
> ERROR: java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2215)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:185)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:165)
> Caused by: java.lang.IndexOutOfBoundsException
> at java.nio.Buffer.checkBounds(Buffer.java:567)
> at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:149)
> at
> org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decode(FastDiffDeltaEncoder.java:465)
> at
> org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decodeNext(FastDiffDeltaEncoder.java:516)
> at
> org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$BufferedEncodedSeeker.next(BufferedDataBlockEncoder.java:618)
> at
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.next(HFileReaderV2.java:1277)
> at
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:180)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:588)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:147)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:5706)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:5865)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5643)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5620)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5606)
> at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6801)
> at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6779)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2029)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33644)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> ... 3 more {noformat}
> Likewise, running {{ hbase hfile -f -p }} on the specific hfile, a subset of
> kv pairs were printed until the program hits the following exception and
> crashes:
> {noformat}
> Exception in thread "main" java.lang.RuntimeException: Unknown code 65
> at org.apache.hadoop.hbase.KeyValue$Type.codeToType(KeyValue.java:259)
> at org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:1246)
> at
> org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$ClonedSeekerState.toString(BufferedDataBlockEncoder.java:506)
> at java.lang.String.valueOf(String.java:2994)
> at java.lang.StringBuilder.append(StringBuilder.java:131)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.scanKeysValues(HFilePrettyPrinter.java:382)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.processFile(HFilePrettyPrinter.java:316)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.run(HFilePrettyPrinter.java:255)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.main(HFilePrettyPrinter.java:677)
> {noformat}
[jira] [Commented] (HBASE-21563) HBase Get Encounters java.lang.IndexOutOfBoundsException
[
https://issues.apache.org/jira/browse/HBASE-21563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724306#comment-16724306
]
William Shen commented on HBASE-21563:
--
Thanks for looking into this [~openinx]. Please let me know if I can help in
any way.
> HBase Get Encounters java.lang.IndexOutOfBoundsException
>
>
> Key: HBASE-21563
> URL: https://issues.apache.org/jira/browse/HBASE-21563
> Project: HBase
> Issue Type: Bug
> Components: HFile
>Affects Versions: 1.2.0
>Reporter: William Shen
>Assignee: Zheng Hu
>Priority: Major
> Attachments: 67a04bc049be4f58afecdcc0a3ba62ca.tar.gz
>
>
> We've recently encountered issue retrieving data from our HBase cluster, and
> have not had much luck troubleshooting the issue. We narrowed down our issue
> to a single GET, which appears to be caused by FastDiffDeltaEncoder.java
> running into java.lang.IndexOutOfBoundsException.
> Perhaps there is a bug on a corner case for FastDiffDeltaEncoder?
> We are running 1.2.0-cdh5.9.2, and the GET in question is:
> {noformat}
> hbase(main):004:0> get 'qa2.ADGROUPS',
> "\x05\x80\x00\x00\x00\x00\x1F\x54\x9C\x80\x00\x00\x00\x00\x1C\x7D\x45\x00\x04\x80\x00\x00\x00\x00\x1D\x0F\x19\x80\x00\x00\x00\x00\x4A\x64\x6F\x80\x00\x00\x00\x01\xD9\xDB\xCE"
> COLUMNCELL
>
>
> ERROR: java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2215)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:185)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:165)
> Caused by: java.lang.IndexOutOfBoundsException
> at java.nio.Buffer.checkBounds(Buffer.java:567)
> at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:149)
> at
> org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decode(FastDiffDeltaEncoder.java:465)
> at
> org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decodeNext(FastDiffDeltaEncoder.java:516)
> at
> org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$BufferedEncodedSeeker.next(BufferedDataBlockEncoder.java:618)
> at
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.next(HFileReaderV2.java:1277)
> at
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:180)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:588)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:147)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:5706)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:5865)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5643)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5620)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5606)
> at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6801)
> at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6779)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2029)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33644)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
> ... 3 more {noformat}
> Likewise, running {{ hbase hfile -f -p }} on the specific hfile, a subset of
> kv pairs were printed until the program hits the following exception and
> crashes:
> {noformat}
> Exception in thread "main" java.lang.RuntimeException: Unknown code 65
> at org.apache.hadoop.hbase.KeyValue$Type.codeToType(KeyValue.java:259)
> at org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:1246)
> at
> org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$ClonedSeekerState.toString(BufferedDataBlockEncoder.java:506)
> at java.lang.String.valueOf(String.java:2994)
> at java.lang.StringBuilder.append(StringBuilder.java:131)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.scanKeysValues(HFilePrettyPrinter.java:382)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.processFile(HFilePrettyPrinter.java:316)
> at
> org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.run(HFilePrettyPrinter.java:255)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
>
[jira] [Created] (HBASE-21563) HBase Get Encounters java.lang.IndexOutOfBoundsException
William Shen created HBASE-21563:
Summary: HBase Get Encounters java.lang.IndexOutOfBoundsException
Key: HBASE-21563
URL: https://issues.apache.org/jira/browse/HBASE-21563
Project: HBase
Issue Type: Bug
Components: HFile
Affects Versions: 1.2.0
Reporter: William Shen
Attachments: 67a04bc049be4f58afecdcc0a3ba62ca.tar.gz
We've recently encountered issue retrieving data from our HBase cluster, and
have not had much luck troubleshooting the issue. We narrowed down our issue to
a single GET, which appears to be caused by FastDiffDeltaEncoder.java running
into java.lang.IndexOutOfBoundsException.
Perhaps there is a bug on a corner case for FastDiffDeltaEncoder?
We are running 1.2.0-cdh5.9.2, and the GET in question is:
{noformat}
hbase(main):004:0> get 'qa2.ADGROUPS',
"\x05\x80\x00\x00\x00\x00\x1F\x54\x9C\x80\x00\x00\x00\x00\x1C\x7D\x45\x00\x04\x80\x00\x00\x00\x00\x1D\x0F\x19\x80\x00\x00\x00\x00\x4A\x64\x6F\x80\x00\x00\x00\x01\xD9\xDB\xCE"
COLUMNCELL
ERROR: java.io.IOException
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2215)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:185)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:165)
Caused by: java.lang.IndexOutOfBoundsException
at java.nio.Buffer.checkBounds(Buffer.java:567)
at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:149)
at
org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decode(FastDiffDeltaEncoder.java:465)
at
org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder$1.decodeNext(FastDiffDeltaEncoder.java:516)
at
org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$BufferedEncodedSeeker.next(BufferedDataBlockEncoder.java:618)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2$EncodedScannerV2.next(HFileReaderV2.java:1277)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:180)
at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108)
at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:588)
at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:147)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:5706)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:5865)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:5643)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5620)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:5606)
at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6801)
at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6779)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2029)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33644)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2170)
... 3 more {noformat}
Likewise, running {{ hbase hfile -f -p }} on the specific hfile, a subset of kv
pairs were printed until the program hits the following exception and crashes:
{noformat}
Exception in thread "main" java.lang.RuntimeException: Unknown code 65
at org.apache.hadoop.hbase.KeyValue$Type.codeToType(KeyValue.java:259)
at org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:1246)
at
org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$ClonedSeekerState.toString(BufferedDataBlockEncoder.java:506)
at java.lang.String.valueOf(String.java:2994)
at java.lang.StringBuilder.append(StringBuilder.java:131)
at
org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.scanKeysValues(HFilePrettyPrinter.java:382)
at
org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.processFile(HFilePrettyPrinter.java:316)
at
org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.run(HFilePrettyPrinter.java:255)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.io.hfile.HFilePrettyPrinter.main(HFilePrettyPrinter.java:677)
{noformat}
I have attached the HFile related to this issue for debugging.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
