> The right configuration parameter is: > set mapred.output.compression.type=BLOCK;
I've set mapred.output.compression.type and changed io.seqfile.compress.blocksize to 100,000,000 (100MB) and now 3600 MB files are down to 260MB! Is such high compression recommended? Saurabh. -- http://nandz.blogspot.com http://foodieforlife.blogspot.com
