Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19622#discussion_r148060497
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala ---
@@ -246,11 +246,11 @@ private[hive] class
HiveMetastoreCatalog(sparkSession: SparkSession) extends Log
inferredSchema match {
case Some(dataSchema) =>
- val schema = StructType(dataSchema ++
relation.tableMeta.partitionSchema)
if (inferenceMode == INFER_AND_SAVE) {
- updateCatalogSchema(relation.tableMeta.identifier, schema)
+ updateDataSchema(relation.tableMeta.identifier, dataSchema)
--- End diff --
Hi, @cloud-fan .
SPARK-22306 also reports the unexpected change of table `owner`. To resolve
SPARK-22306, we need to keep the original `owner` during `INFER_AND_SAVE`. It
seems to be the only remaining thing here. Could you consider that in this PR
please, too?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
