Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/20404#discussion_r164364286
--- Diff: python/pyspark/sql/session.py ---
@@ -213,7 +213,12 @@ def __init__(self, sparkContext, jsparkSession=None):
self._jsc = self._sc._jsc
self._jvm = self._sc._jvm
if jsparkSession is None:
- jsparkSession = self._jvm.SparkSession(self._jsc.sc())
+ if self._jvm.SparkSession.getDefaultSession().isDefined() \
+ and not
self._jvm.SparkSession.getDefaultSession().get() \
+ .sparkContext().isStopped():
--- End diff --
I think so. I will do it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
