Include the commons-math3/3.3 in class path while submitting jar to spark cluster. Like.. spark-submit --driver-class-path maths3.3jar --class MainClass --master spark cluster url appjar
On Mon, Nov 17, 2014 at 1:55 PM, Ritesh Kumar Singh [via Apache Spark User List] <ml-node+s1001560n19055...@n3.nabble.com> wrote: > My sbt file for the project includes this: > > libraryDependencies ++= Seq( > "org.apache.spark" %% "spark-core" % "1.1.0", > "org.apache.spark" %% "spark-mllib" % "1.1.0", > "org.apache.commons" % "commons-math3" % "3.3" > ) > ============================================================= > > Still I am getting this error: > > >java.lang.NoClassDefFoundError: > org/apache/commons/math3/random/RandomGenerator > > ============================================================= > > The jar at location: ~/.m2/repository/org/apache/commons/commons-math3/3.3 > contains the random generator class: > > $ jar tvf commons-math3-3.3.jar | grep RandomGenerator > >org/apache/commons/math3/random/RandomGenerator.class > >org/apache/commons/math3/random/UniformRandomGenerator.class > >org/apache/commons/math3/random/SynchronizedRandomGenerator.class > >org/apache/commons/math3/random/AbstractRandomGenerator.class > >org/apache/commons/math3/random/RandomGeneratorFactory$1.class > >org/apache/commons/math3/random/RandomGeneratorFactory.class > >org/apache/commons/math3/random/StableRandomGenerator.class > >org/apache/commons/math3/random/NormalizedRandomGenerator.class > >org/apache/commons/math3/random/JDKRandomGenerator.class > >org/apache/commons/math3/random/GaussianRandomGenerator.class > > > Please help > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/RandomGenerator-class-not-found-exception-tp19055.html > To start a new topic under Apache Spark User List, email > ml-node+s1001560n1...@n3.nabble.com > To unsubscribe from Apache Spark User List, click here > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=bGVhcm5pbmdzLmNoaXR0dXJpQGdtYWlsLmNvbXwxfC03NzExMjUwMg==> > . > NAML > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/RandomGenerator-class-not-found-exception-tp19055p19057.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
