[
https://issues.apache.org/jira/browse/SPARK-21085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048720#comment-16048720
]
Apache Spark commented on SPARK-21085:
--------------------------------------
User 'gatorsmile' has created a pull request for this issue:
https://github.com/apache/spark/pull/18295
> Failed to read the partitioned table created by Spark 2.1
> ---------------------------------------------------------
>
> Key: SPARK-21085
> URL: https://issues.apache.org/jira/browse/SPARK-21085
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Xiao Li
> Assignee: Xiao Li
> Priority: Blocker
>
> Spark 2.2 is unable to read the partitioned table created by Spark 2.1 when
> the table schema does not put the partitioning column at the end of the
> schema.
> {noformat}
> assert(partitionFields.map(_.name) == partitionColumnNames)
> {noformat}
> The codes are from the following files:
> https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala#L234-L236
> When reading the table metadata from the metastore, we also need to reorder
> the columns.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
