Re: Avro file Compression

2013-08-22 Thread Harsh J
Can you share your test? There is an example at http://svn.apache.org/repos/asf/avro/trunk/lang/c/examples/quickstop.c which has the right calls for using a file writer with a deflate codec - is yours similar? On Mon, Aug 19, 2013 at 9:42 PM, amit nanda amit...@gmail.com wrote: I am try to

Re: Avro file Compression

2013-08-22 Thread Scott Carey
The file format compresses in blocks, and the block size is configurable. This will compress across objects in a block, so it works for small objects as well as large ones ‹ as long as the total block size is large enough. I have found that I can increase the ratio of compression by ordering the