Try adding
<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-lang3</artifactId>
<version>3.3.2</version>
</dependency>
On Mon, Mar 16, 2015 at 7:40 PM, Tharinda Ehelepola <[email protected]>
wrote:
> Hi,
>
> I studied about apache spark these days. I 'm still stuck in building
> part. I went through different links and finally decided to build it using
> intellij. I have found most of the libraries but still errors occur when
> running examples.
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/commons/lang3/SystemUtils
> at org.apache.spark.util.Utils$.<init>(Utils.scala:1476)
> at org.apache.spark.util.Utils$.<clinit>(Utils.scala)
> at org.apache.spark.SparkContext.<init>(SparkContext.scala:70)
> at
> org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:61)
> at org.apache.spark.examples.JavaLogQuery.main(JavaLogQuery.java:105)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.commons.lang3.SystemUtils
> at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 10 more
> Exception in thread "delete Spark temp dirs"
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.spark.util.Utils$
> at org.apache.spark.util.Utils$$anon$4.run(Utils.scala:175)
>
>
> Here I added some errors. *Apache Spark* is a fast and general engine for
> big data processing. Wrangler is to data cleaning and transformation. So
> what I got is some spark methods related to wrangler scripts. If I can get
> proper knowledge about spark java API I can use that for conversion of
> wrangler scripts to java. And also it will help me to get proper idea about
> the whole project. So can you please give me some tips for building apache
> spark.
>
> Thank you,
> Tharinda.
>
--
Thanks & regards,
Nirmal
Senior Software Engineer- Platform Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
