[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2019-10-25 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959827#comment-16959827 ] Wes McKinney commented on ARROW-300: There are some discussions on going at

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2019-10-25 Thread Yuan Zhou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959552#comment-16959552 ] Yuan Zhou commented on ARROW-300: - Hi [~wesm], thanks for providing the general idea, I'm quite interested

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2018-09-17 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617883#comment-16617883 ] Wes McKinney commented on ARROW-300: Moving this to 0.12. I will make a proposal for compressed record

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2018-03-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392262#comment-16392262 ] Wes McKinney commented on ARROW-300: We haven't done any work on this yet. I think the first step would

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2018-03-08 Thread Lawrence Chan (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392124#comment-16392124 ] Lawrence Chan commented on ARROW-300: - What did we decide with this? Imho there's still a use case for

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-09-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176938#comment-16176938 ] Wes McKinney commented on ARROW-300: We have had all of the pieces in place in C++ that we need to do

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-05-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008315#comment-16008315 ] Kazuaki Ishizaki commented on ARROW-300: Thank you for your response. I was also busy for preparing

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-05-06 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999611#comment-15999611 ] Wes McKinney commented on ARROW-300: I'm sorry for the delay. With the 0.3 Arrow release done, it would

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-19 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975288#comment-15975288 ] Kazuaki Ishizaki commented on ARROW-300: [~wesmckinn] Thank you for your kindly and positive

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967616#comment-15967616 ] Wes McKinney commented on ARROW-300: [~kiszk] I agree that having in-memory compression schemes like in

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-13 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967452#comment-15967452 ] Uwe L. Korn commented on ARROW-300: --- Adding methods like RLE- or Delta-encoding brings us very much in

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-10 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963751#comment-15963751 ] Kazuaki Ishizaki commented on ARROW-300: Current Apache Spark supports [the following compression

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-10-26 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15608798#comment-15608798 ] Uwe L. Korn commented on ARROW-300: --- +1 Compression makes sense to me and also the list of initial

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-10-26 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15608768#comment-15608768 ] Wes McKinney commented on ARROW-300: It may make sense to limit to compressors designed for fast