RE: File Compression

2007-11-13 Thread Devaraj Das
7 PM > To: [email protected] > Subject: File Compression > > I have a question about file compression in Hadoop. When I > set the io.seqfile.compression.type=BLOCK does this also > compress actual files I load in the DFS or does this only > control the map/

Re: File Compression

2007-11-13 Thread Arun C Murthy
Michael, On Tue, Nov 13, 2007 at 08:56:36AM -0800, Michael Harris wrote: >I have a question about file compression in Hadoop. When I set the >io.seqfile.compression.type=BLOCK does this also compress actual files I load >in the DFS or does this only control the map/reduce file compre

File Compression

2007-11-13 Thread Michael Harris
I have a question about file compression in Hadoop. When I set the io.seqfile.compression.type=BLOCK does this also compress actual files I load in the DFS or does this only control the map/reduce file compression? If it doesnt compress the files on the file system, is there any way to compress