cloud-fan commented on a change in pull request #28511:
URL: https://github.com/apache/spark/pull/28511#discussion_r425651119
##########
File path:
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala
##########
@@ -321,4 +340,42 @@ case class InsertIntoHiveTable(
isSrcLocal = false)
}
}
+
+ // scalastyle:off line.size.limit
+ /**
+ * If the table location and partition location do not belong to the same
[[FileSystem]], We
+ * should not disable hive overwrite. Otherwise, hive will use the
[[FileSystem]] instance belong
Review comment:
can we treat this as a known limitation, with the faith that most users
will use Hive 2.x in the long term? Then we just need to check the version.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
