Oleksiy Dyagilev created ZEPPELIN-1211:
------------------------------------------
Summary: running interpreter on windows with SPARK_SUBMIT
Key: ZEPPELIN-1211
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1211
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.6.0
Environment: Windows
Reporter: Oleksiy Dyagilev
How to repro:
- on Windows
- create /conf/zeppelin-env.cmd
- define SPARK_HOME and SPARK_SUBMIT_OPTIONS with "--jars ..." there
- start Zeppelin and run some spark notes
Observed:
- Zeppelin fails with errors
The problem:
in interpeter.cmd
when SPARK_SUBMIT is defined it calls
"%SPARK_SUBMIT%" --class %ZEPPELIN_SERVER% --jars %CLASSPATH%
--driver-java-options "!JAVA_INTP_OPTS!" %SPARK_SUBMIT_OPTIONS%
"%SPARK_APP_JAR%" %PORT%
I think it's wrong to use %CLASSPATH% for --jars.
--jars expects comma separated jars and CLASSPATH is colon separated
Also, when SPARK_SUBMIT is not defined, it calls
"%ZEPPELIN_RUNNER%" !JAVA_INTP_OPTS! %ZEPPELIN_INTP_MEM% -cp
%ZEPPELIN_CLASSPATH_OVERRIDES%;%CLASSPATH% %ZEPPELIN_SERVER% %PORT%
Note, that CLASSPATH will already include the content of
ZEPPELIN_CLASSPATH_OVERRIDES. Find the line above
set CLASSPATH=%ZEPPELIN_CLASSPATH_OVERRIDES%;%ZEPPELIN_CLASSPATH%
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
