Hi Young, Appreciate the help. I do have hadoop in the path but its not the apache version of hadoop, but specific distribution of hadoop, built on top of apache hadoop, 2.0.4. Following command gives the attached output. cmd>hadoop version Hadoop 2.0.4-<distro_name> Subversion https://sh-ssvn.sh.<xxxxx>.com/ssg_repos/aaa -r 1089
Do you know, if I need to make any change to use custom hadoop, which is built on top of the apache hadoop? Again, thanks for extending the help. Highly appreciated. Regards Rob On Tue, Jan 21, 2014 at 2:22 PM, Young Han <[email protected]> wrote: > Hi, > > Could it be that you're missing the path to Hadoop? > > Young > > On 2014-01-21 2:25 PM, "Rob Paul" <[email protected]> wrote: >> >> Hi, >> Does anyone knows, what's missing? Why I can't compile giraph. I am >> new to Girah and sorry, if I am missing something very trivial. >> Regards >> Rob >> ===================Below is the error============================ >> >> [INFO] Building jar: >> >> /home/rob/dev/apache/giraph-trunk/giraph/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar >> [INFO] >> [INFO] --- maven-antrun-plugin:1.6:run (default) @ giraph-core --- >> [INFO] Executing tasks >> >> main: >> [java] java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable >> [java] at >> org.apache.tools.ant.taskdefs.ExecuteJava.execute(ExecuteJava.java:194) >> [java] at org.apache.tools.ant.taskdefs.Java.run(Java.java:771) >> [java] at >> org.apache.tools.ant.taskdefs.Java.executeJava(Java.java:221) >> [java] at >> org.apache.tools.ant.taskdefs.Java.executeJava(Java.java:135) >> [java] at >> org.apache.tools.ant.taskdefs.Java.execute(Java.java:108) >> [java] at >> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> [java] at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> [java] at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> [java] at java.lang.reflect.Method.invoke(Method.java:606) >> [java] at >> >> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) >> [java] at org.apache.tools.ant.Task.perform(Task.java:348) >> [java] at org.apache.tools.ant.Target.execute(Target.java:390) >> [java] at >> org.apache.tools.ant.Target.performTasks(Target.java:411) >> [java] at >> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397) >> [java] at >> org.apache.tools.ant.Project.executeTarget(Project.java:1366) >> [java] at >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270) >> [java] at >> >> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106) >> [java] at >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) >> [java] at >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) >> [java] at >> >> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) >> [java] at >> >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) >> [java] at >> >> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) >> [java] at >> >> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) >> [java] at >> >> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) >> [java] at >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:318) >> [java] at >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:153) >> [java] at >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:555) >> [java] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214) >> [java] at org.apache.maven.cli.MavenCli.main(MavenCli.java:158) >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> [java] at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> [java] at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> [java] at java.lang.reflect.Method.invoke(Method.java:606) >> [java] at >> >> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) >> [java] at >> >> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) >> [java] at >> >> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:414) >> [java] at >> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:357) >> [java] Caused by: java.lang.NoClassDefFoundError: >> org/apache/hadoop/io/Writable >> [java] at java.lang.ClassLoader.defineClass1(Native Method) >> [java] at java.lang.ClassLoader.defineClass(ClassLoader.java:792) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) >> [java] at >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) >> [java] at >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> [java] at java.lang.ClassLoader.defineClass1(Native Method) >> [java] at java.lang.ClassLoader.defineClass(ClassLoader.java:792) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) >> [java] at >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) >> [java] at >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> [java] at java.lang.ClassLoader.defineClass1(Native Method) >> [java] at java.lang.ClassLoader.defineClass(ClassLoader.java:792) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) >> [java] at >> >> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) >> [java] at >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) >> [java] at >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> [java] at >> org.apache.giraph.conf.GiraphConstants.<clinit>(GiraphConstants.java:135) >> [java] at >> org.apache.giraph.conf.AllOptions.main(AllOptions.java:153) >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> [java] at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> [java] at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> [java] at java.lang.reflect.Method.invoke(Method.java:606) >> [java] at >> org.apache.tools.ant.taskdefs.ExecuteJava.run(ExecuteJava.java:217) >> [java] at >> org.apache.tools.ant.taskdefs.ExecuteJava.execute(ExecuteJava.java:152) >> [java] ... 37 more >> [java] Caused by: java.lang.ClassNotFoundException: >> org.apache.hadoop.io.Writable >> [java] at >> >> org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1361) >> [java] at >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) >> [java] at >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> [java] ... 69 more >> [java] Java Result: -1 >> [INFO] Executed tasks >> [INFO] >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Reactor Summary: >> [INFO] >> [INFO] Apache Giraph Parent .............................. SUCCESS >> [7.474s] >> [INFO] Apache Giraph Core ................................ SUCCESS >> [1:02.431s] >> [INFO] Apache Giraph Examples ............................ FAILURE >> [0.312s] >> [INFO] Apache Giraph HBase I/O ........................... SKIPPED >> [INFO] Apache Giraph Accumulo I/O ........................ SKIPPED >> [INFO] Apache Giraph Rexster I/O ......................... SKIPPED >> [INFO] Apache Giraph HCatalog I/O ........................ SKIPPED >> [INFO] Apache Giraph Hive I/O ............................ SKIPPED >> [INFO] Apache Giraph Distribution ........................ SKIPPED >> [INFO] Apache Giraph Gora I/O ............................ SKIPPED >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] BUILD FAILURE >> [INFO] >> ------------------------------------------------------------------------ >> [INFO] Total time: 1:12.383s >> [INFO] Finished at: Mon Jan 20 17:25:46 PST 2014 >> [INFO] Final Memory: 31M/119M >> [INFO] >> ------------------------------------------------------------------------ >> [ERROR] Failed to execute goal on project giraph-examples: Could not >> resolve dependencies for project >> org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: Failure to find >> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT in >> http://repo1.maven.org/maven2 was cached in the local repository, >> resolution will not be reattempted until the update interval of >> central has elapsed or updates are forced -> [Help 1]
