Hi Stan, HBase itself stores KVs in SequenceFiles when writing to the write-ahead log and it's able to read them, so I know for sure that that mechanism works. Would you mind writing a small unit test to show us how you trigger your issue?
Thanks, J-D On Thu, Aug 4, 2011 at 6:54 AM, Stan Barton <[email protected]> wrote: > > Hello, > > I am encountering strange error using HBase 0.90.3, the scenario: > > I am writing KeyValues in Sequence files as an intermediate input for > further bulk loading using MapReduce. The problem I am facing is that when I > try to read the KeyValues from the sequence file in the Mapper (in order to > emit them for sorting) they are garbled and thus the whole job fails because > of the Exceptions thrown by trying to process the garbled keyvalues. For > instance, when trying to output the KeyValue object I get > java.lang.ArrayIndexOutOfBoundsException or java.lang.RuntimeException: > Unknown code XX. > > I have spent a lot of time in order to track down the bug and found out that > when I write the SequenceFile of KeyValues with HBase 0.90.3 I cannot read > the content back using the same HBase version jar, however I am able to read > it without any problems with HBase 0.20.* versions. It is easily > reproducible with this unit test. > > As for Hadoop, I am using the Cloudera distribution CDH3 Beta 2. > > Thanks for help. > > Stan Barton > -- > View this message in context: > http://old.nabble.com/Possible-bug-in-reading-KeyValues-from-sequence-files-in-HBase-0.90-tp32194680p32194680.html > Sent from the HBase User mailing list archive at Nabble.com. > >
