To reiterate on this , here is the full commands I used: sudo wget http://mirrors.nxnethosting.com/apache/giraph/giraph-1.1.0/giraph-dist-1.1.0-src.tar.gz sudo tar xzf giraph-dist-1.1.0-src.tar.gz sudo chown -R hduser:hadoop giraph-1.1.0 (you can set the user to whatever, in my case it was just “hadoop” use) sudo mv giraph-dist-1.1.0 giraph mvn -e -Phadoop_yarn -Dhadoop.version=2.4.0 -DskipTests package
Note: I specified “hadoop.version=2.4.0” as I’m using the latest Amazon EMR AMI version 3.6.0. Also, I tried the same command above with “install” instead of package, and for some reason it failed. -Tamer From: José Luis Larroque [mailto:[email protected]] Sent: Thursday, February 26, 2015 8:55 PM To: [email protected] Subject: Re: Compiling Giraph 1.1 Hi again guys: I find a solution. Don't use the clone indicated in the "Quick Start Guide". The pom has 1.2 version, so is looking for dependencies for that version in maven repositories, and those jar's don't exist, because giraph 1.2 hasn't been released, yet. Instead of doing the clone (sudo git clone https://github.com/apache/giraph.git), the solution is do the following steps: sudo wget http://mirrors.nxnethosting.com/apache/giraph/giraph-1.1.0/giraph-dist-1.1.0-src.tar.gz sudo tar xzf giraph-dist-1.1.0-src.tar.gz sudo chown -R hduser:hadoop giraph-1.1.0 sudo mv giraph-dist-1.1.0 giraph And the build finish without errors, finally!! Good bye! 2015-02-22 23:31 GMT-03:00 José Luis Larroque <[email protected]<mailto:[email protected]>>: Hi Ryan, i'm facing same problem here. Did you find any solution for this? I'm building giraph with another hadoop version, but the problem appears to be the same, that dependency can't be resolved: mvn -e -Phadoop_yarn -Dhadoop.version=2.4.0 -DskipTests clean install I'm not applying the fix of removing STATIC_SASL_SYMBOL from this line: <munge.symbols>PURE_YARN,STATIC_SASL_SYMBOL</munge.symbols> 2014-12-08 13:21 GMT-03:00 Ryan <[email protected]<mailto:[email protected]>>: Any thoughts? Still not able to install unfortunately. Ryan On Sun, Nov 30, 2014 at 9:00 PM, Ryan <[email protected]<mailto:[email protected]>> wrote: I believe I was. I was building directly from a new clone of the github repository. It turns out I should be installing YARN instead of the Hadoop_2 profile. When I run ' mvn -DskipTests -Dhadoop.version=2.3.0-cdh5.1.2 -Phadoop_yarn clean install' I get the error: Failed to execute goal on project giraph-dist: Could not resolve dependencies for project org.apache.giraph:giraph-dist:pom:1.2.0-SNAPSHOT: Failure to find org.apache.giraph:giraph-rexster-io:jar:1.2.0-SNAPSHOT in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] Would a fix have to do with the giraph-rexster-io:jar:1.2.0-SNAPSHOT? On Sun, Nov 9, 2014 at 7:32 PM, Claudio Martella <[email protected]<mailto:[email protected]>> wrote: I just built trunk with that command. Are you sure you're building latest trunk? On Fri, Nov 7, 2014 at 3:21 PM, Ryan <[email protected]<mailto:[email protected]>> wrote: Any updated thoughts on this? On Tue, Nov 4, 2014 at 5:59 PM, Ryan <[email protected]<mailto:[email protected]>> wrote: It's 'mvn -Phadoop_2 -fae -DskipTests clean install' Thanks, Ryan On Tue, Nov 4, 2014 at 2:02 PM, Roman Shaposhnik <[email protected]<mailto:[email protected]>> wrote: What's the exact compilation incantation you use? Thanks, Roman. On Tue, Nov 4, 2014 at 9:56 AM, Ryan <[email protected]<mailto:[email protected]>> wrote: > I'm attempting to build, compile and install Giraph 1.1 on a server running > CDH5.1.2. A few weeks ago I successfully compiled it by changing the > hadoop_2 profile version to be 2.3.0-cdh5.1.2. I recently did a fresh > install and was unable to build, compile and install (perhaps due to the > latest code updates). > > The error seems to be related to the SaslNettyClient and SaslNettyServer. > Any idea on fixes? > > Here's part of the error log: > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-compiler-plugin:3.0:compile (default-compile) > on project giraph-core: Compilation failure: Compilation failure: > [ERROR] > /[myPath]/giraph/giraph-core/src/main/java/org/apache/giraph/comm/netty/SaslNettyClient.java:[28,34] > cannot find symbol > [ERROR] symbol: class SaslPropertiesResolver > [ERROR] location: package org.apache.hadoop.security > ... > [ERROR] > /[myPath]/giraph/giraph-core/src/main/java/org/apache/giraph/comm/netty/SaslNettyServer.java:[108,11] > cannot find symbol > [ERROR] symbol: variable SaslPropertiesResolver > [ERROR] location: class org.apache.giraph.comm.netty.SaslNettyServer > -- Claudio Martella
