I migrated from Hive-0.30 to Hive-trunk (r802989 compiled against Hadoop 0.18.3), copied over metastore_db & the conf directory. Output compression used to work with my earlier Hive installation, but it seems to have stopped working now. Are the configuration parameters different from Hive-0.3?
"set -v" on Hive-trunk throws up the following relevant configuration parameters: mapred.output.compress=false hive.exec.compress.intermediate=false hive.exec.compress.output=true mapred.output.compression.type=BLOCK mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec mapred.map.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec io.seqfile.compress.blocksize=1000000 io.seqfile.lazydecompress=true mapred.compress.map.output=false io.compression.codecs=org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec What am I missing? Saurabh. -- http://nandz.blogspot.com http://foodieforlife.blogspot.com
