yaooqinn commented on a change in pull request #25977:
[SPARK-29268][SQL]isolationOn value is wrong in case of
spark.sql.hive.metastore.jars != builtin
URL: https://github.com/apache/spark/pull/25977#discussion_r329999618
##########
File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala
##########
@@ -414,7 +415,7 @@ private[spark] object HiveUtils extends Logging {
hadoopConf = hadoopConf,
execJars = jars.toSeq,
config = configurations,
- isolationOn = true,
+ isolationOn = !isCliSessionState(),
Review comment:
If you are using !built-in hive jars and turn off the isolation, which means
using the SparkContxetClassLoader to load them directly , then you probably get
hive class or jar conflicts with the spark built-in ones during the runtime
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
