We upgraded to Hadoop 0.20.1 and Hbase 0.90.1 (both CDH3B4). We are using 64bit machines.

Starting goes great, only right after the first compaction we get this error:
Uncaught exception in service thread regionserver60020.compactor
java.lang.AbstractMethodError: com.hadoop.compression.lzo.LzoCompressor.reinit(Lorg/apache/hadoop/conf/Configuration;)V at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:105) at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:112) at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:200) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.getCompressingStream(HFile.java:397) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.newBlock(HFile.java:383) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkBlockBoundary(HFile.java:354) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:536) at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:501) at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.append(StoreFile.java:836) at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:935) at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:733) at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:769) at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:714) at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:81)

Lzo worked fine. This is how I believe we used it.
# LZO compression in Hbase will pass through three layers:
# 1) hadoop-gpl-compression-*.jar in the hbase/lib directory; the entry point # 2) libgplcompression.* in the hbase native lib directory; the native connectors
# 3) liblzo2.so.2 in the hbase native lib directory; the base native library

Anyway, it would be great if somebody could help us out.

Reply via email to