Github user yhuai commented on the pull request:
https://github.com/apache/spark/pull/4729#issuecomment-76309465
Maybe I did not explain it clearly. SPARK-6023 and SPARK-5950 are two bugs,
the first one is that we failed to replace the destination MetastoreRelation in
InsertIntoTable even we ask Spark SQL to convert all MetastoreRelations
associated with parquet tables to our data source parquet tables. The root
cause for this one was clear and the fix is pretty simple. The second bug is
arrays (maybe maps and structs?) written by Hive's parquet serde may not be
able to read by data source parquet table. SPARK-5950 is for this bug. Since
this pr is not ready (I will leave comments later), I made #4782 and we checked
in it first to fix SPARK-6023.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
