cloud-fan commented on a change in pull request #27492: [SPARK-30755][SQL]
Update migration guide for HIVE-15167
URL: https://github.com/apache/spark/pull/27492#discussion_r380011292
##########
File path:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
##########
@@ -318,7 +318,14 @@ private[hive] class HiveClientImpl(
// with the HiveConf in `state` to override the context class loader of
the current
// thread.
shim.setCurrentSessionState(state)
- val ret = try f finally {
+ val ret = try {
+ f
+ } catch {
+ case e: NoClassDefFoundError
+ if HiveUtils.isHive23 &&
e.getMessage.contains("org/apache/hadoop/hive/serde2/SerDe") =>
+ throw new ClassNotFoundException("The SerDe interface removed since
Hive 2.3(HIVE-15167)." +
+ " Please migrate your custom SerDes to Hive 2.3. See HIVE-15167
for more details.", e)
Review comment:
shall we mention that, users can build Spark themselves with hive 1.2
profile?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
