[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2022-04-19 Thread Kyle Barron (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524365#comment-17524365 ] Kyle Barron commented on ARROW-8674: > Maybe. Let's make sure to compare native gzip compression that

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2022-04-18 Thread Dominik Moritz (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523988#comment-17523988 ] Dominik Moritz commented on ARROW-8674: --- https://github.com/manzt/numcodecs.js looks interesting as

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2022-04-18 Thread Dominik Moritz (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523985#comment-17523985 ] Dominik Moritz commented on ARROW-8674: --- > For one, gzip compression is much slower than LZ4 or

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2022-04-18 Thread Kyle Barron (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523786#comment-17523786 ] Kyle Barron commented on ARROW-8674: Thanks for the feedback! {quote}We also should look into how

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2022-04-17 Thread Dominik Moritz (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523434#comment-17523434 ] Dominik Moritz commented on ARROW-8674: --- Looking at lz4js, it's so small

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2022-04-15 Thread Kyle Barron (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522941#comment-17522941 ] Kyle Barron commented on ARROW-8674: Hello! I'd like to revisit this issue and potentially submit a

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2021-04-24 Thread Dominik Moritz (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331343#comment-17331343 ] Dominik Moritz commented on ARROW-8674: --- Yes, but at the same time someone might want to use Arrow

[jira] [Commented] (ARROW-8674) [JS] Implement IPC RecordBatch body buffer compression from ARROW-300

2021-01-17 Thread eric mauviere (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266879#comment-17266879 ] eric mauviere commented on ARROW-8674: -- I strongly suport this because if library size is a concern