[
https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299009#comment-14299009
]
DeepakVohra edited comment on SPARK-5483 at 1/30/15 7:09 PM:
-------------------------------------------------------------
Thanks for the clarification about why the master URL is not set.
Is the Maven dependency >spark-mllib_2.10 not a Spark issue?
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-mllib_2.10</artifactId>
<version>1.2.0</version>
</dependency>
There must be some issue in how you are adding the classes to the classpath.
Modifying "2.10" to "2.11" fixes the issue and the org.apache.spark.mllib.*
packages get found, but introduces the Scala version issue.
was (Author: dvohra):
Is the Maven dependency >spark-mllib_2.10 not a Spark issue?
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-mllib_2.10</artifactId>
<version>1.2.0</version>
</dependency>
There must be some issue in how you are adding the classes to the classpath.
Modifying "2.10" to "2.11" fixes the issue and the org.apache.spark.mllib.*
packages get found, but introduces the Scala version issue.
> java.lang.NoSuchMethodError:
> scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-5483
> URL: https://issues.apache.org/jira/browse/SPARK-5483
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 1.2.0
> Environment: Maven
> Spark 1.2
> Reporter: DeepakVohra
>
> Naive Bayes classifier generates following error.
> ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
> java.lang.NoSuchMethodError:
> scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> at
> breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> at
> breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> at
> breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> at
> breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> at
> org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> at
> org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> at
> org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> at
> org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> at
> org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> at
> org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> at
> org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> at
> org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> at org.apache.spark.scheduler.Task.run(Task.scala:56)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 15/01/28 21:50:06 ERROR SparkUncaughtExceptionHandler: Uncaught exception in
> thread Thread[Executor task launch worker-0,5,main]
> java.lang.NoSuchMethodError:
> scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> at
> breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> at
> breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> at
> breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> at
> breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> at
> org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> at
> org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> at
> org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> at
> org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> at
> org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> at
> org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> at
> org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> at
> org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> at org.apache.spark.scheduler.Task.run(Task.scala:56)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
