Lantao Jin created ZEPPELIN-1544:
------------------------------------
Summary: upgrade default spark-2.0 version to spark-2.0.1
Key: ZEPPELIN-1544
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1544
Project: Zeppelin
Issue Type: Bug
Reporter: Lantao Jin
Apache Spark 2.0.1 is a maintenance release containing 300 stability and bug
fixes. It is strongly recommend all 2.0.0 users to upgrade to this stable
release.
Zeppelin use Spark 2.0.0 as default version of spark-2.0 profile. But if you
add "-Dspark.version=2.0.1" to build with the stable version, it will failed by
mis-matching py4j version because that the py4j in spark-2.0.1 had been upgrade
to 0.10.3. [SPARK-17220|https://issues.apache.org/jira/browse/SPARK-17220]
{code:java}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-antrun-plugin:1.7:run (zip-pyspark-files) on
project zeppelin-spark-dependencies_2.10: An Ant BuildException has occured:
Warning: Could not find file
/Users/lajin/git/apache/zeppelin/spark-dependencies/target/spark-dist/spark-2.0.1/python/lib/py4j-0.10.1-src.zip
to copy.
[ERROR] around Ant part ...<copy todir="../interpreter/spark/pyspark"
file="/Users/lajin/git/apache/zeppelin/spark-dependencies/target/spark-dist/spark-2.0.1/python/lib/py4j-0.10.1-src.zip"/>...
@ 5:167 in
/Users/lajin/git/apache/zeppelin/spark-dependencies/target/antrun/build-main.xml
{code}
So why not upgrade the default spark version to 2.0.1 for profile (spark-2.0)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
