In our setup, we didn't change io.seqfile.compress.blocksize (1MB) and it's still fairly good. You are free to try 100MB for better compression ratio, but I would recommend to keep the default setting to minimize the possibilities of hitting unknown bugs.
Zheng On Mon, Jul 27, 2009 at 10:38 PM, Saurabh Nanda<[email protected]> wrote: > >> The right configuration parameter is: >> set mapred.output.compression.type=BLOCK; > > I've set mapred.output.compression.type and changed > io.seqfile.compress.blocksize to 100,000,000 (100MB) and now 3600 MB files > are down to 260MB! > > Is such high compression recommended? > > Saurabh. > -- > http://nandz.blogspot.com > http://foodieforlife.blogspot.com > -- Yours, Zheng
