Hi,
I studied about apache spark these days. I 'm still stuck in building part.
I went through different links and finally decided to build it using
intellij. I have found most of the libraries but still errors occur when
running examples.
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/commons/lang3/SystemUtils
at org.apache.spark.util.Utils$.<init>(Utils.scala:1476)
at org.apache.spark.util.Utils$.<clinit>(Utils.scala)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:70)
at
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:61)
at org.apache.spark.examples.JavaLogQuery.main(JavaLogQuery.java:105)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
Caused by: java.lang.ClassNotFoundException:
org.apache.commons.lang3.SystemUtils
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 10 more
Exception in thread "delete Spark temp dirs"
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.spark.util.Utils$
at org.apache.spark.util.Utils$$anon$4.run(Utils.scala:175)
Here I added some errors. *Apache Spark* is a fast and general engine for
big data processing. Wrangler is to data cleaning and transformation. So
what I got is some spark methods related to wrangler scripts. If I can get
proper knowledge about spark java API I can use that for conversion of
wrangler scripts to java. And also it will help me to get proper idea about
the whole project. So can you please give me some tips for building apache
spark.
Thank you,
Tharinda.
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
