-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28435/
-----------------------------------------------------------
Review request for hive, Szehon Ho and Xuefu Zhang.
Bugs: HIVE-8959
https://issues.apache.org/jira/browse/HIVE-8959
Repository: hive-git
Description
-------
During unit test, SparkSession is closed by Runtime shutdownHook, which means
it's closed until JVM exist. During unit test suite, each qfile, as a single
test case, would reset SessionState, which lead to a new Sparksession is
created for each qfile. As we know that, RemoteSparkClient is SparkSession
specified, so more and more executors is launched during unit test until
blocked by no more resources.
Diffs
-----
itests/qtest-spark/pom.xml b31db8e
itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java 3f47749
Diff: https://reviews.apache.org/r/28435/diff/
Testing
-------
Thanks,
chengxiang li