Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16179
@gatorsmile that is not the change that surfaced the problem. Again, this
change is not to work around a bug in Hive. This change is because Spark is
doing things incorrectly, and we were just lucky to not hit this problem
before. Hive is correct. Spark is not. Thus the change.
The changes that actually surface the problem are in Hive 2.1, which Spark
does not yet support (officially at least?) as a metastore client.
Internally we have patches from Hive 2.1 in our Hive, so we started seeing
this problem. Because Spark is behaving incorrectly, it's better to fix it to
avoid future issues.
`VersionSuite` is not meant to capture these things; it's meant to make
sure the `HiveShim` reflection code is doing the right thing for the various
versions of Hive. In fact, it's not the test that failed for us (the
"InsertIntoHiveTable" did).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
