Rahul Jain created SPARK-17261:
----------------------------------
Summary: Using HiveContext after re-creating SparkContext in Spark
2.0 throws "Java.lang.illegalStateException: Cannot call methods on a stopped
sparkContext"
Key: SPARK-17261
URL: https://issues.apache.org/jira/browse/SPARK-17261
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 2.0.0
Environment: Amazon AWS EMR 5.0
Reporter: Rahul Jain
Fix For: 2.0.0
After stopping SparkSession if we recreate it and use HiveContext in it. it
will throw error.
Steps to reproduce:
spark = SparkSession.builder.enableHiveSupport().getOrCreate()
spark.sql("show databases")
spark.stop()
spark = SparkSession.builder.enableHiveSupport().getOrCreate()
spark.sql("show databases")
"Java.lang.illegalStateException: Cannot call methods on a stopped sparkContext"
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
