Wes McKinney created ARROW-300:

             Summary: [Format] Add buffer compression option to IPC file format
                 Key: ARROW-300
                 URL: https://issues.apache.org/jira/browse/ARROW-300
             Project: Apache Arrow
          Issue Type: New Feature
          Components: Format
            Reporter: Wes McKinney

It may be useful if data is to be sent over the wire to compress the data 
buffers themselves as their being written in the file layout.

I would propose that we keep this extremely simple with a global buffer 
compression setting in the file Footer. Probably only two compressors worth 
supporting out of the box would be zlib (higher compression ratios) and lz4 
(better performance).

What does everyone think?

This message was sent by Atlassian JIRA

Reply via email to