[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2021-03-24 Thread Li Xian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308292#comment-17308292 ] Li Xian commented on SPARK-26345: - [~dongjoon] sure, I have created a new issue

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2021-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308144#comment-17308144 ] Dongjoon Hyun commented on SPARK-26345: --- Thank you for reporting. Could you file a new JIRA,

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2021-03-24 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308000#comment-17308000 ] Xinli Shang commented on SPARK-26345: - Yes, it needs some synchronization. I have the modified

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2021-03-24 Thread Li Xian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307590#comment-17307590 ] Li Xian commented on SPARK-26345: - [~yumwang] I think the current implementation has a problem. the

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248526#comment-17248526 ] Yuming Wang commented on SPARK-26345: - [~jamestaylor] Please see

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-12 Thread James R. Taylor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248412#comment-17248412 ] James R. Taylor commented on SPARK-26345: - Those results are excellent, [~yumwang]. I thought

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248374#comment-17248374 ] Yuming Wang commented on SPARK-26345: - Benchmark and benchmark result: {code:scala} /* * Licensed

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248323#comment-17248323 ] Yuming Wang commented on SPARK-26345: - We have a pr test compatibility against Parquet 1.11.1, Avro

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-11 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248241#comment-17248241 ] Xinli Shang commented on SPARK-26345: - The Presto and Iceberg effort are not tied to each other. It

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-11 Thread James R. Taylor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248236#comment-17248236 ] James R. Taylor commented on SPARK-26345: - Thanks for the update, [~sha...@uber.com]. I had just

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-11 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248231#comment-17248231 ] Xinli Shang commented on SPARK-26345: - For the performance, there is an Eng Blog I found online

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-12-11 Thread James R. Taylor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248216#comment-17248216 ] James R. Taylor commented on SPARK-26345: - Any updates on this issue, [~zi]? Wouldn't column

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-07-21 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162313#comment-17162313 ] Holden Karau commented on SPARK-26345: -- We don't assign issues normally until after the merge.

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-07-21 Thread Felix Kizhakkel Jose (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162311#comment-17162311 ] Felix Kizhakkel Jose commented on SPARK-26345: -- [~sha...@uber.com] I don't have permission

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-07-21 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162063#comment-17162063 ] Xinli Shang commented on SPARK-26345: - [~yumwang][~FelixKJose], you can assign this JIra to me. When

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2020-03-30 Thread Felix Kizhakkel Jose (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070982#comment-17070982 ] Felix Kizhakkel Jose commented on SPARK-26345: -- I have created a Jira in Parquet-mr for

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

2019-01-31 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757209#comment-16757209 ] Zoltan Ivanfi commented on SPARK-26345: --- Please note that column indexes will automatically get