[
https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-7743.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.5.0
> Upgrade Parquet to 1.7
> ----------------------
>
> Key: SPARK-7743
> URL: https://issues.apache.org/jira/browse/SPARK-7743
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Thomas Omans
> Fix For: 1.5.0
>
>
> There are many outstanding issues with the parquet format that have been
> resolved between the version depended on by spark (1.6.0rc3 as of spark
> 1.3.1) and the most recent parquet release (1.6.0).
> Some of these are things include not supporting schema migration when using
> parquet with avro, not supporting summary metadata in the parquet footers
> causing null pointer exceptions reading, and many others.
> See https://github.com/apache/parquet-mr/blob/master/CHANGES.md#version-160
> for the full list of fixes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
