Hmm.. sorry no, I've only used Giraph with Apache Hadoop 1.0.4 myself. I asked because of the "java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable" lines in the output.
As per Owen's suggestion, I also needed to use -DskipTests to compile successfully. Perhaps for Hadoop 2.0.4 you also need -Phadoop_2.0? So something like: mvn clean install -Phadoop_2.0 -DskipTests Young On Tue, Jan 21, 2014 at 5:34 PM, Rob Paul <[email protected]> wrote: > Hi Young, > > Appreciate the help. I do have hadoop in the path but its not the > apache version of hadoop, but specific distribution of hadoop, built > on top of apache hadoop, 2.0.4. Following command gives the attached > output. > cmd>hadoop version > Hadoop 2.0.4-<distro_name> > Subversion https://sh-ssvn.sh.<xxxxx>.com/ssg_repos/aaa -r 1089 > > Do you know, if I need to make any change to use custom hadoop, which > is built on top of the apache hadoop? > Again, thanks for extending the help. Highly appreciated. > Regards > Rob > > > > On Tue, Jan 21, 2014 at 2:22 PM, Young Han <[email protected]> wrote: > > Hi, > > > > Could it be that you're missing the path to Hadoop? > > > > Young > > > > On 2014-01-21 2:25 PM, "Rob Paul" <[email protected]> wrote: > >> > >> Hi, > >> Does anyone knows, what's missing? Why I can't compile giraph. I am > >> new to Girah and sorry, if I am missing something very trivial. > >> Regards > >> Rob > >> ===================Below is the error============================ > >> > >> [INFO] Building jar: > >> > >> > /home/rob/dev/apache/giraph-trunk/giraph/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar > >> [INFO] > >> [INFO] --- maven-antrun-plugin:1.6:run (default) @ giraph-core --- > >> [INFO] Executing tasks > >> > >> main: > >> [java] java.lang.NoClassDefFoundError: > org/apache/hadoop/io/Writable > >> [java] at > >> org.apache.tools.ant.taskdefs.ExecuteJava.execute(ExecuteJava.java:194) > >> [java] at org.apache.tools.ant.taskdefs.Java.run(Java.java:771) > >> [java] at > >> org.apache.tools.ant.taskdefs.Java.executeJava(Java.java:221) > >> [java] at > >> org.apache.tools.ant.taskdefs.Java.executeJava(Java.java:135) > >> [java] at > >> org.apache.tools.ant.taskdefs.Java.execute(Java.java:108) > >> [java] at > >> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > >> Method) > >> [java] at > >> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >> [java] at > >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >> [java] at java.lang.reflect.Method.invoke(Method.java:606) > >> [java] at > >> > >> > org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) > >> [java] at org.apache.tools.ant.Task.perform(Task.java:348) > >> [java] at org.apache.tools.ant.Target.execute(Target.java:390) > >> [java] at > >> org.apache.tools.ant.Target.performTasks(Target.java:411) > >> [java] at > >> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397) > >> [java] at > >> org.apache.tools.ant.Project.executeTarget(Project.java:1366) > >> [java] at > >> org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270) > >> [java] at > >> > >> > org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) > >> [java] at > >> > >> > org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) > >> [java] at > >> org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:318) > >> [java] at > >> org.apache.maven.DefaultMaven.execute(DefaultMaven.java:153) > >> [java] at > >> org.apache.maven.cli.MavenCli.execute(MavenCli.java:555) > >> [java] at > org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214) > >> [java] at org.apache.maven.cli.MavenCli.main(MavenCli.java:158) > >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > >> Method) > >> [java] at > >> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >> [java] at > >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >> [java] at java.lang.reflect.Method.invoke(Method.java:606) > >> [java] at > >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) > >> [java] at > >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) > >> [java] at > >> > >> > org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:414) > >> [java] at > >> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:357) > >> [java] Caused by: java.lang.NoClassDefFoundError: > >> org/apache/hadoop/io/Writable > >> [java] at java.lang.ClassLoader.defineClass1(Native Method) > >> [java] at > java.lang.ClassLoader.defineClass(ClassLoader.java:792) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) > >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > >> [java] at java.lang.ClassLoader.defineClass1(Native Method) > >> [java] at > java.lang.ClassLoader.defineClass(ClassLoader.java:792) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) > >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > >> [java] at java.lang.ClassLoader.defineClass1(Native Method) > >> [java] at > java.lang.ClassLoader.defineClass(ClassLoader.java:792) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) > >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > >> [java] at > >> > org.apache.giraph.conf.GiraphConstants.<clinit>(GiraphConstants.java:135) > >> [java] at > >> org.apache.giraph.conf.AllOptions.main(AllOptions.java:153) > >> [java] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > >> Method) > >> [java] at > >> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >> [java] at > >> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >> [java] at java.lang.reflect.Method.invoke(Method.java:606) > >> [java] at > >> org.apache.tools.ant.taskdefs.ExecuteJava.run(ExecuteJava.java:217) > >> [java] at > >> org.apache.tools.ant.taskdefs.ExecuteJava.execute(ExecuteJava.java:152) > >> [java] ... 37 more > >> [java] Caused by: java.lang.ClassNotFoundException: > >> org.apache.hadoop.io.Writable > >> [java] at > >> > >> > org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1361) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) > >> [java] at > >> org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1070) > >> [java] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > >> [java] ... 69 more > >> [java] Java Result: -1 > >> [INFO] Executed tasks > >> [INFO] > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] Reactor Summary: > >> [INFO] > >> [INFO] Apache Giraph Parent .............................. SUCCESS > >> [7.474s] > >> [INFO] Apache Giraph Core ................................ SUCCESS > >> [1:02.431s] > >> [INFO] Apache Giraph Examples ............................ FAILURE > >> [0.312s] > >> [INFO] Apache Giraph HBase I/O ........................... SKIPPED > >> [INFO] Apache Giraph Accumulo I/O ........................ SKIPPED > >> [INFO] Apache Giraph Rexster I/O ......................... SKIPPED > >> [INFO] Apache Giraph HCatalog I/O ........................ SKIPPED > >> [INFO] Apache Giraph Hive I/O ............................ SKIPPED > >> [INFO] Apache Giraph Distribution ........................ SKIPPED > >> [INFO] Apache Giraph Gora I/O ............................ SKIPPED > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] BUILD FAILURE > >> [INFO] > >> ------------------------------------------------------------------------ > >> [INFO] Total time: 1:12.383s > >> [INFO] Finished at: Mon Jan 20 17:25:46 PST 2014 > >> [INFO] Final Memory: 31M/119M > >> [INFO] > >> ------------------------------------------------------------------------ > >> [ERROR] Failed to execute goal on project giraph-examples: Could not > >> resolve dependencies for project > >> org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: Failure to find > >> org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT in > >> http://repo1.maven.org/maven2 was cached in the local repository, > >> resolution will not be reattempted until the update interval of > >> central has elapsed or updates are forced -> [Help 1] >
