Hi Joey,
Thanks. I forgot to say that; yes, the lzocodec class is listed in
core-site.xml under the io.compression.codecs property:

<property>
  <name>io.compression.codecs</name>
  
<value>org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec,org.apache.hadoop.io.compress.BZip2Codec</value>
</property>

I also added the mapred.child.env property to mapred site:

 <property>
    <name>mapred.child.env</name>
    <value>JAVA_LIBRARY_PATH=/usr/lib/hadoop-0.20/lib</value>
  </property>

per these instructions:
http://www.cloudera.com/blog/2009/11/hadoop-at-twitter-part-1-splittable-lzo-compression/

After making each of these changes I have restarted the cluster --
just to be sure that the new changes were being picked up.

Jessica

Reply via email to