[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2019-10-25 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959827#comment-16959827 ] Wes McKinney commented on ARROW-300: There are some discussions on going at https://l

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2019-10-25 Thread Yuan Zhou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959552#comment-16959552 ] Yuan Zhou commented on ARROW-300: - Hi [~wesm], thanks for providing the general idea, I'm

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2018-09-17 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16617883#comment-16617883 ] Wes McKinney commented on ARROW-300: Moving this to 0.12. I will make a proposal for c

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2018-03-08 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392262#comment-16392262 ] Wes McKinney commented on ARROW-300: We haven't done any work on this yet. I think the

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2018-03-08 Thread Lawrence Chan (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392124#comment-16392124 ] Lawrence Chan commented on ARROW-300: - What did we decide with this? Imho there's still

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-10-20 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212918#comment-16212918 ] Wes McKinney commented on ARROW-300: Moving to 0.9.0. I don't think I can get to this i

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-09-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16176938#comment-16176938 ] Wes McKinney commented on ARROW-300: We have had all of the pieces in place in C++ that

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-05-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008315#comment-16008315 ] Kazuaki Ishizaki commented on ARROW-300: Thank you for your response. I was also bu

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-05-06 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999611#comment-15999611 ] Wes McKinney commented on ARROW-300: I'm sorry for the delay. With the 0.3 Arrow releas

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-19 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975288#comment-15975288 ] Kazuaki Ishizaki commented on ARROW-300: [~wesmckinn] Thank you for your kindly and

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967616#comment-15967616 ] Wes McKinney commented on ARROW-300: [~kiszk] I agree that having in-memory compression

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-13 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967452#comment-15967452 ] Uwe L. Korn commented on ARROW-300: --- Adding methods like RLE- or Delta-encoding brings us

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2017-04-10 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963751#comment-15963751 ] Kazuaki Ishizaki commented on ARROW-300: Current Apache Spark supports [the followi

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-11-15 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667983#comment-15667983 ] Uwe L. Korn commented on ARROW-300: --- Given my latest (sadly internal) performance tests,

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-11-15 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667895#comment-15667895 ] Wes McKinney commented on ARROW-300: One issue with doing compression only at the trans

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-10-26 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608905#comment-15608905 ] Julien Le Dem commented on ARROW-300: - I'm thinking that we don't really need to compre

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-10-26 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608798#comment-15608798 ] Uwe L. Korn commented on ARROW-300: --- +1 Compression makes sense to me and also the list o

[jira] [Commented] (ARROW-300) [Format] Add buffer compression option to IPC file format

2016-10-26 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608768#comment-15608768 ] Wes McKinney commented on ARROW-300: It may make sense to limit to compressors designed