[
https://issues.apache.org/jira/browse/SPARK-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-6777:
------------------------------
Description: When converting Parquet schemas to/from Spark SQL schemas, we
should recognize commonly used legacy non-standard representation of complex
types. We can follow the pattern used in Parquet's {{AvroSchemaConverter}}.
(was: When converting a Parquet schema to Spark SQL schema, we should recognize
commonly used legacy non-standard representation of complex types. We can
follow the pattern used in Parquet's {{AvroSchemaConverter}}.)
> Implement backwards-compatibility rules in Parquet schema converters
> --------------------------------------------------------------------
>
> Key: SPARK-6777
> URL: https://issues.apache.org/jira/browse/SPARK-6777
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 1.0.2, 1.1.1, 1.2.1, 1.3.0, 1.4.0
> Reporter: Cheng Lian
> Priority: Critical
>
> When converting Parquet schemas to/from Spark SQL schemas, we should
> recognize commonly used legacy non-standard representation of complex types.
> We can follow the pattern used in Parquet's {{AvroSchemaConverter}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
