[
https://issues.apache.org/jira/browse/SPARK-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156365#comment-14156365
]
Igor Tkachenko edited comment on SPARK-3761 at 10/2/14 10:55 AM:
-----------------------------------------------------------------
I've tried sbt 12.4, but unfortunately with no luck. I'd like to emphasize that
I am using spark-assembly lib with version _2.10;1.0.0-cdh5.1.0 from
repository http://repository.cloudera.com/artifactory/repo/ as we are using
cloudera image CDH 5.1.0 and can't use any other version due to serialization
issues.
was (Author: legart):
I've tried sbt 12.4, but unfortunately with no luck. I'd like to emphasize that
I am using with version _2.10;1.0.0-cdh5.1.0 from repository
http://repository.cloudera.com/artifactory/repo/ as we are using cloudera image
CDH 5.1.0 and can't use any other version due to serialization issues.
> Class anonfun$1 not found exception / sbt 13.x / Scala 2.10.4
> -------------------------------------------------------------
>
> Key: SPARK-3761
> URL: https://issues.apache.org/jira/browse/SPARK-3761
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Igor Tkachenko
> Priority: Blocker
>
> I have Scala code:
> val master = "spark://<server address>:7077"
> val sc = new SparkContext(new SparkConf()
> .setMaster(master)
> .setAppName("SparkQueryDemo 01")
> .set("spark.executor.memory", "512m"))
> val count2 = sc .textFile("hdfs://<server
> address>:8020/tmp/data/risk/account.txt")
> .filter(line => line.contains("Word"))
> .count()
> I've got such an error:
> [error] (run-main-0) org.apache.spark.SparkException: Job aborted due to
> stage failure: Task 0.0:0 failed 4 times, most
> recent failure: Exception failure in TID 6 on host <server address>:
> java.lang.ClassNotFoundExcept
> ion: SimpleApp$$anonfun$1
> My dependencies :
> object Version {
> val spark = "1.0.0-cdh5.1.0"
> }
> object Library {
> val sparkCore = "org.apache.spark" % "spark-assembly_2.10" %
> Version.spark
> }
> My OS is Win 7, sbt 13.5, Scala 2.10.4
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
