srowen commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610#issuecomment-587107789 It looks plausible, but @viirya what do you think too? Indeed SQLContext is more or less deprecated, but should still work while it exists. It seems a little funny to manage its lifecycle in SparkSession, but, there is no way to stop a SQLContext from Pyspark? or at least there is no method that unsets the instantiated context, at all. This seems like an OK place to do it, given that SparkSession does create the SQLContext too.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
