Poking in our mail archives, does it help? For example: http://search-hadoop.com/m/QMDV41Sh1GI/lzo+compression&subj=LZO+Compression St.Ack
On Wed, Mar 16, 2011 at 10:28 AM, Ferdy Galema <[email protected]> wrote: > We upgraded to Hadoop 0.20.1 and Hbase 0.90.1 (both CDH3B4). We are using > 64bit machines. > > Starting goes great, only right after the first compaction we get this > error: > Uncaught exception in service thread regionserver60020.compactor > java.lang.AbstractMethodError: > com.hadoop.compression.lzo.LzoCompressor.reinit(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:105) > at > org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:112) > at > org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:200) > at > org.apache.hadoop.hbase.io.hfile.HFile$Writer.getCompressingStream(HFile.java:397) > at > org.apache.hadoop.hbase.io.hfile.HFile$Writer.newBlock(HFile.java:383) > at > org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkBlockBoundary(HFile.java:354) > at > org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:536) > at > org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:501) > at > org.apache.hadoop.hbase.regionserver.StoreFile$Writer.append(StoreFile.java:836) > at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:935) > at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:733) > at > org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:769) > at > org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:714) > at > org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:81) > > Lzo worked fine. This is how I believe we used it. > # LZO compression in Hbase will pass through three layers: > # 1) hadoop-gpl-compression-*.jar in the hbase/lib directory; the entry > point > # 2) libgplcompression.* in the hbase native lib directory; the native > connectors > # 3) liblzo2.so.2 in the hbase native lib directory; the base native library > > Anyway, it would be great if somebody could help us out. >
