Lantao Jin created ZEPPELIN-1544: ------------------------------------ Summary: upgrade default spark-2.0 version to spark-2.0.1 Key: ZEPPELIN-1544 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1544 Project: Zeppelin Issue Type: Bug Reporter: Lantao Jin
Apache Spark 2.0.1 is a maintenance release containing 300 stability and bug fixes. It is strongly recommend all 2.0.0 users to upgrade to this stable release. Zeppelin use Spark 2.0.0 as default version of spark-2.0 profile. But if you add "-Dspark.version=2.0.1" to build with the stable version, it will failed by mis-matching py4j version because that the py4j in spark-2.0.1 had been upgrade to 0.10.3. [SPARK-17220|https://issues.apache.org/jira/browse/SPARK-17220] {code:java} [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (zip-pyspark-files) on project zeppelin-spark-dependencies_2.10: An Ant BuildException has occured: Warning: Could not find file /Users/lajin/git/apache/zeppelin/spark-dependencies/target/spark-dist/spark-2.0.1/python/lib/py4j-0.10.1-src.zip to copy. [ERROR] around Ant part ...<copy todir="../interpreter/spark/pyspark" file="/Users/lajin/git/apache/zeppelin/spark-dependencies/target/spark-dist/spark-2.0.1/python/lib/py4j-0.10.1-src.zip"/>... @ 5:167 in /Users/lajin/git/apache/zeppelin/spark-dependencies/target/antrun/build-main.xml {code} So why not upgrade the default spark version to 2.0.1 for profile (spark-2.0) -- This message was sent by Atlassian JIRA (v6.3.4#6332)