Are your LZO files indexed? -Joey
On Wed, Oct 5, 2011 at 3:35 PM, Jessica Owensby <[email protected]> wrote: > Hi Joey, > Thanks. I forgot to say that; yes, the lzocodec class is listed in > core-site.xml under the io.compression.codecs property: > > <property> > <name>io.compression.codecs</name> > <value>org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec,org.apache.hadoop.io.compress.BZip2Codec</value> > </property> > > I also added the mapred.child.env property to mapred site: > > <property> > <name>mapred.child.env</name> > <value>JAVA_LIBRARY_PATH=/usr/lib/hadoop-0.20/lib</value> > </property> > > per these instructions: > http://www.cloudera.com/blog/2009/11/hadoop-at-twitter-part-1-splittable-lzo-compression/ > > After making each of these changes I have restarted the cluster -- > just to be sure that the new changes were being picked up. > > Jessica > -- Joseph Echeverria Cloudera, Inc. 443.305.9434
