Ashnee Sharma created ZEPPELIN-6021:
---------------------------------------
Summary: Spark interpreter
Key: ZEPPELIN-6021
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6021
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.11.0, 0.10.1, 0.10.0
Environment: Test and Prod !image-2024-05-21-21-17-02-102.png!
!image-2024-05-21-21-17-41-751.png!
Reporter: Ashnee Sharma
Attachments: image-2024-05-21-21-17-02-102.png,
image-2024-05-21-21-17-41-751.png
I have spark 3.2.0 installed with java 11. While trying to run spark interprter
in client mode I am getting below error.
org.apache.zeppelin.interpreter.InterpreterException:
org.apache.zeppelin.interpreter.InterpreterException: Fail to open
SparkInterpreter at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:861)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:769)
at org.apache.zeppelin.scheduler.Job.run(Job.java:186) at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:135)
at
org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829) Caused by:
org.apache.zeppelin.interpreter.InterpreterException: Fail to open
SparkInterpreter at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:140) at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(
And When I am trying to in cluster mode for %spark.pyspark
I am getting below error.
org.apache.zeppelin.interpreter.InterpreterException:
org.apache.zeppelin.interpreter.InterpreterException: Fail to bootstrap pyspark
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:861)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:769)
at org.apache.zeppelin.scheduler.Job.run(Job.java:186) at
org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:135)
at
org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829) Caused by:
org.apache.zeppelin.interpreter.InterpreterException: Fail to bootstrap pyspark
at
org.apache.zeppelin.spark.PySparkInterpreter.open(PySparkInterpreter.java:103)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
... 8 more Caused by: java.io.IOException: Fail to run bootstrap script:
python/zeppelin_pyspark.py
Fail to execute line 21: from pyspark.conf import SparkConf.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
