Yeap. First error is: 2011-03-28 11:51:20,067 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=aggregate_metrics,,1287788994878.798601f279423cf9155a3078fbc5e86b. java.io.IOException: java.lang.RuntimeException: native-lzo library not available at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:88) at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:2555) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2544) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2532) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:262) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:94) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:151) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:680) Caused by: java.lang.RuntimeException: native-lzo library not available at com.hadoop.compression.lzo.LzoCodec.getCompressorType(LzoCodec.java:147) at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:100) at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:112) at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:200) at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:83)
On Mon, Mar 28, 2011 at 11:35 AM, Friso van Vollenhoven < [email protected]> wrote: > Yes, things changed a bit. The compressors now have a reinit(...) method > that allows HBase to reuse the objects. I believe Hadoop still works > > Here's the version that should be good: > https://github.com/toddlipcon/hadoop-lzo > > If you're already on a recent version, then something else might have gone > wrong. I think the stack trace you posted indicates that there is an error > earlier in the RS logs that shows what is wrong with the compressor. > "Algorithm 'lzo' previously failed test". Look for when the test happened. > > > Cheers, > Friso > > > On 28 mrt 2011, at 17:01, George P. Stathis wrote: > > Has anything changed with the way compression is handled in 0.90? > > I'm in the process of testing 0.90 CDH3B4 on my development machine (OS X). > Up until 0.89 SNAPSHOTS, I have been able to re-use the same lzo JAR and > native libs that I compiled back in 0.20.x. With this latest upgrade, I now > see this in the region server logs: > > 2011-03-28 10:54:51,787 ERROR > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open > of region=monitors,,1287788998658.a6c3f7f6a927fda960a856c274b470c0. > java.io.IOException: Compression algorithm 'lzo' previously failed test. > at > > org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:77) > at > > org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:2555) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2544) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2532) > at > > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:262) > at > > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:94) > at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:151) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:680) > > Just want to make sure I'm not missing something before I start > re-compiling > those libs. > > -GS > >
