Hi, I'm building Giraph on a VM with CDH4 installed and running. I'll be running jobs on a 6 machine cluster running CDH4.
I've checked out trunk and attempted a build. Giraph builds successfully but giraph-formats-contrib fails to build with a failure to find Giraph. I'd like to make use of HBase as my storage, possibly combining the Girpah output format with a Vertere (https://github.com/mmmmmrob/Vertere), a tool I use to convert tabular data into a graph (currently RDF). I've tried installing the giraph jar into my local maven cache with mvn install:install-file -Dfile=giraph/target/giraph-0.2-SNAPSHOT-for-hadoop-2.0.0-alpha-jar-with-dependencies.jar -DgroupId=org.apache.giraph -DartifactId=giraph -Dversion=0.2-SNAPSHOT -Dpackaging=jar That seems to make no difference AFAICT. Any help appreciated. Build output below: [robst@data giraph]$ mvn clean compile [INFO] Scanning for projects... [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] Apache Giraph Parent [INFO] Apache Giraph [INFO] Apache Giraph Formats [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Giraph Parent 0.2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ parent --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Giraph 0.2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ giraph --- [INFO] Deleting /home/robst/giraph/giraph/target [INFO] [INFO] --- maven-enforcer-plugin:1.0.1:enforce (enforce-maven) @ giraph --- [INFO] [INFO] --- munge-maven-plugin:1.0:munge (munge) @ giraph --- [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ giraph --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /home/robst/giraph/giraph/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ giraph --- [INFO] Compiling 331 source files to /home/robst/giraph/giraph/target/munged/classes [INFO] [INFO] --- maven-assembly-plugin:2.3:single (build-fat-jar) @ giraph --- [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/NOTICE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/NOTICE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/NOTICE already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/NOTICE already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/ASL2.0 already added, skipping [INFO] META-INF/NOTICE already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] Building jar: /home/robst/giraph/giraph/target/giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/NOTICE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/NOTICE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/NOTICE already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/LICENSE.txt already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/NOTICE already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/ASL2.0 already added, skipping [INFO] META-INF/NOTICE already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] META-INF/MANIFEST.MF already added, skipping [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Giraph Formats 0.2-SNAPSHOT [INFO] ------------------------------------------------------------------------ [WARNING] Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, no dependency information available [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Giraph Parent .............................. SUCCESS [0.202s] [INFO] Apache Giraph ..................................... SUCCESS [11.186s] [INFO] Apache Giraph Formats ............................. FAILURE [0.381s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 11.984s [INFO] Finished at: Thu Nov 08 14:28:41 GMT 2012 [INFO] Final Memory: 29M/494M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project giraph-formats-contrib: Could not resolve dependencies for project org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find org.apache.giraph:giraph:jar:tests:0.2-SNAPSHOT in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :giraph-formats-contrib
