[
https://issues.apache.org/jira/browse/MAHOUT-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608860#comment-15608860
]
Suneel Marthi commented on MAHOUT-1889:
---------------------------------------
We don't support Spark 2.x yet and yes the Mahout spark shell had to be tweaked
with each Spark upgrade, in large part thanks to the Spark community for
incompatible and breaking changes that come with each Spark release.
Its not on the immediate roadmap to fix this, and its the least priority at the
moment for the project to be supporting Spark 2.x. Most Mahout users are still
on Spark 1.5x or 1.6x, so it doesn't make sense moving to Spark 2.x.
Feel free to submit a PR for Spark 2x support nevertheless.
> Mahout doesn't work with Spark 2.0
> ----------------------------------
>
> Key: MAHOUT-1889
> URL: https://issues.apache.org/jira/browse/MAHOUT-1889
> Project: Mahout
> Issue Type: Bug
> Reporter: Sergey Svinarchuk
>
> In Spark 2.0 was changes path to libraries and classpath. If change classpath
> to correct for Spark 2.0, all Spark job failed with
> java.lang.NoSuchMethodError: , because Spark API was changed.
> Example for spark-shell:
> {code}
> ./bin/mahout spark-shell
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.spark.repl.SparkILoop.setPrompt(Ljava/lang/String;)V
> at
> org.apache.mahout.sparkbindings.shell.MahoutSparkILoop.<init>(MahoutSparkILoop.scala:58)
> at org.apache.mahout.sparkbindings.shell.Main$.main(Main.scala:32)
> at org.apache.mahout.sparkbindings.shell.Main.main(Main.scala)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
