[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065210#comment-16065210
]
Michael Styles commented on SPARK-21218:
In Parquet 1.7, there as a bug involving corrupt
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065177#comment-16065177
]
Andrew Duffy commented on SPARK-21218:
--
Curious, I wonder what the previous benchmarks were lacking.
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065142#comment-16065142
]
Michael Styles commented on SPARK-21218:
[~hyukjin.kwon] Not sure I understand what you want me
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064880#comment-16064880
]
Hyukjin Kwon commented on SPARK-21218:
--
Yea, I support this for what it worth. Let's resolve this as
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064608#comment-16064608
]
Michael Styles commented on SPARK-21218:
By not pushing the filter to Parquet, are we not
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063981#comment-16063981
]
Andrew Duffy commented on SPARK-21218:
--
Good catch, looks like a dupe. [~hyukjin.kwon] did profiling
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063925#comment-16063925
]
Hyukjin Kwon commented on SPARK-21218:
--
I believe it is a duplicate of SPARK-17091.
> Convert IN
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063620#comment-16063620
]
Apache Spark commented on SPARK-21218:
--
User 'ptkool' has created a pull request for this issue: