It's still not working. Keep getting the same error.
I even deleted the commons-math3/* folder containing the jar. And then
under the directory "org/apache/commons/" made a folder called 'math3' and
put the commons-math3-3.3.jar in it.
Still its not working.
I also tried sc.addJar("/path/to/jar") within spark-shell and in my project
sourcefile
It still didn't import the jar at both locations.
More
Any fixes? Please help
On Mon, Nov 17, 2014 at 2:14 PM, Chitturi Padma <
learnings.chitt...@gmail.com> wrote:
> Include the commons-math3/3.3 in class path while submitting jar to spark
> cluster. Like..
> spark-submit --driver-class-path maths3.3jar --class MainClass --master
> spark cluster url appjar
>
> On Mon, Nov 17, 2014 at 1:55 PM, Ritesh Kumar Singh [via Apache Spark User
> List] <[hidden email] <http://user/SendEmail.jtp?type=node&node=19057&i=0>
> > wrote:
>
>> My sbt file for the project includes this:
>>
>> libraryDependencies ++= Seq(
>> "org.apache.spark" %% "spark-core" % "1.1.0",
>> "org.apache.spark" %% "spark-mllib" % "1.1.0",
>> "org.apache.commons" % "commons-math3" % "3.3"
>> )
>> =============================================================
>>
>> Still I am getting this error:
>>
>> >java.lang.NoClassDefFoundError:
>> org/apache/commons/math3/random/RandomGenerator
>>
>> =============================================================
>>
>> The jar at location:
>> ~/.m2/repository/org/apache/commons/commons-math3/3.3 contains the random
>> generator class:
>>
>> $ jar tvf commons-math3-3.3.jar | grep RandomGenerator
>> >org/apache/commons/math3/random/RandomGenerator.class
>> >org/apache/commons/math3/random/UniformRandomGenerator.class
>> >org/apache/commons/math3/random/SynchronizedRandomGenerator.class
>> >org/apache/commons/math3/random/AbstractRandomGenerator.class
>> >org/apache/commons/math3/random/RandomGeneratorFactory$1.class
>> >org/apache/commons/math3/random/RandomGeneratorFactory.class
>> >org/apache/commons/math3/random/StableRandomGenerator.class
>> >org/apache/commons/math3/random/NormalizedRandomGenerator.class
>> >org/apache/commons/math3/random/JDKRandomGenerator.class
>> >org/apache/commons/math3/random/GaussianRandomGenerator.class
>>
>>
>> Please help
>>
>>
>> ------------------------------
>> If you reply to this email, your message will be added to the
>> discussion below:
>>
>> http://apache-spark-user-list.1001560.n3.nabble.com/RandomGenerator-class-not-found-exception-tp19055.html
>> To start a new topic under Apache Spark User List, email [hidden email]
>> <http://user/SendEmail.jtp?type=node&node=19057&i=1>
>> To unsubscribe from Apache Spark User List, click here.
>> NAML
>> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
>
> ------------------------------
> View this message in context: Re: RandomGenerator class not found
> exception
> <http://apache-spark-user-list.1001560.n3.nabble.com/RandomGenerator-class-not-found-exception-tp19055p19057.html>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>
