here you are sbt package [info] Set current project to Simple Project (in build file:/home/hduser/dba/bin/scala/) [success] Total time: 1 s, completed Mar 4, 2016 2:50:16 PM hduser@rhes564::/home/hduser/dba/bin/scala> spark-submit --class "SimpleApp" --master local target/scala-2.10/simple-project_2.10-1.0.jar Some(/home/hduser/dba/bin/scala/target/scala-2.10/simple-project_2.10-1.0.jar) Lines with a: 60, Lines with b: 29 Exception in thread "main" java.lang.NoClassDefFoundError: edu/berkeley/cs/succinct/package$ at SimpleApp$.main(SimpleApp.scala:31) at SimpleApp.main(SimpleApp.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:674) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:120) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: java.lang.ClassNotFoundException: edu.berkeley.cs.succinct.package$ at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 11 more
Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 4 March 2016 at 15:04, Ted Yu <yuzhih...@gmail.com> wrote: > Can you show the complete stack trace ? > > It was clear which class whose definition was not found. > > On Fri, Mar 4, 2016 at 6:46 AM, Mich Talebzadeh <mich.talebza...@gmail.com > > wrote: > >> Hi, >> >> I have a simple Scala code that I want to use it in an sbt project. >> >> It is pretty simple but imports the following: >> >> // Import SuccinctRDD >> import edu.berkeley.cs.succinct._ >> >> >> name := "Simple Project" >> version := "1.0" >> scalaVersion := "2.10.5" >> libraryDependencies += "org.apache.spark" %% "spark-core" % "1.5.0" >> libraryDependencies += "org.apache.spark" %% "spark-sql" % "1.0.0" >> libraryDependencies += "org.apache.spark" %% "spark-hive" % "1.5.0" >> libraryDependencies += "amplab" % "succinct" % "0.1.5" >> >> The jar file is created OK but at execution time it fails >> >> >> *sbt package*[info] Set current project to Simple Project (in build >> file:/home/hduser/dba/bin/scala/) >> [success] Total time: 1 s, completed Mar 4, 2016 2:50:16 PM >> >> *spark-submit --class "SimpleApp" --master local >> target/scala-2.10/simple-project_2.10-1.0.jar* >> Some(/home/hduser/dba/bin/scala/target/scala-2.10/simple-project_2.10-1.0.jar) >> Lines with a: 60, Lines with b: 29 >> Exception in thread "main" java.lang.NoClassDefFoundError: >> edu/berkeley/cs/succinct/package$ >> >> >> I suspect I have not got the Library dependencies corrects? >> >> >> Dr Mich Talebzadeh >> >> >> >> LinkedIn * >> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >> >> >> >> http://talebzadehmich.wordpress.com >> >> >> > >