[
https://issues.apache.org/jira/browse/SPARK-13127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248235#comment-16248235
]
Ivan Gozali commented on SPARK-13127:
-------------------------------------
Hello! I was looking to find more information on Parquet string comparison
issues and eventually found my way here. I was just curious to see if this
issue has been resolved by upgrading Parquet to 1.8.2, since that's what the PR
referenced here seems to suggest? Are there still any benefits to be gained by
upgrading to Parquet 1.9.0?
> Upgrade Parquet to 1.9 (Fixes parquet sorting)
> ----------------------------------------------
>
> Key: SPARK-13127
> URL: https://issues.apache.org/jira/browse/SPARK-13127
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0, 2.0.1
> Reporter: Justin Pihony
>
> Currently, when you write a sorted DataFrame to Parquet, then reading the
> data back out is not sorted by default. [This is due to a bug in
> Parquet|https://issues.apache.org/jira/browse/PARQUET-241] that was fixed in
> 1.9.
> There is a workaround to read the file back in using a file glob (filepath/*).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
