Repository: spark
Updated Branches:
  refs/heads/branch-2.3 49771ac8d -> f3a9a7f6b

[SPARK-23275][SQL] fix the thread leaking in hive/tests

## What changes were proposed in this pull request?

This is a follow up of

The two lines actually can trigger the hive metastore bug:

The two configs are not in the default `ObjectStore` properties, so any run 
hive commands after these two lines will set the `propsChanged` flag in the 
`ObjectStore.setConf` and then cause thread leaks.

I don't think the two lines are very useful. They can be removed safely.

## How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, 
manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, 
remove this)

Please review before opening a pull 

Author: Feng Liu <>

Closes #20562 from liufengdb/fix-omm.

(cherry picked from commit 6d7c38330e68c7beb10f54eee8b4f607ee3c4136)
Signed-off-by: gatorsmile <>


Branch: refs/heads/branch-2.3
Commit: f3a9a7f6b6eac4421bd74ff73a74105982604ce6
Parents: 49771ac8
Author: Feng Liu <>
Authored: Fri Feb 9 16:21:47 2018 -0800
Committer: gatorsmile <>
Committed: Fri Feb 9 16:22:14 2018 -0800

 .../src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala   | 2 --
 1 file changed, 2 deletions(-)
diff --git 
index 59708e7..1902893 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala
@@ -530,8 +530,6 @@ private[hive] class TestHiveSparkSession(
       // For some reason, RESET does not reset the following variables...
       metadataHive.runSqlHive("set hive.table.parameters.default=")
-      metadataHive.runSqlHive("set datanucleus.cache.collections=true")
-      metadataHive.runSqlHive("set datanucleus.cache.collections.lazy=true")
       // Lots of tests fail if we do not change the partition whitelist from 
the default.

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to