Hi Tamer, i'm starting to use Giraph in Amazon EMR and i could see that you already try build giraph with maven there. Did you analyse uploading your giraph jar locally build with maven? I saw some questions in stack overflow that are recommending that option instead of yours.
Thanks in advance! Jose 2015-04-02 10:43 GMT-03:00 Tamer Yousef <[email protected]>: > To reiterate on this , here is the full commands I used: > > > > sudo wget > http://mirrors.nxnethosting.com/apache/giraph/giraph-1.1.0/giraph-dist-1.1.0-src.tar.gz > > sudo tar xzf giraph-dist-1.1.0-src.tar.gz > > sudo chown -R hduser:hadoop giraph-1.1.0 (you can set the user to > whatever, in my case it was just “hadoop” use) > > sudo mv giraph-dist-1.1.0 giraph > > mvn -e -Phadoop_yarn -Dhadoop.version=2.4.0 -DskipTests package > > > > Note: I specified “hadoop.version=2.4.0” as I’m using the latest Amazon > EMR AMI version 3.6.0. > > Also, I tried the same command above with “install” instead of package, > and for some reason it failed. > > > > -Tamer > > > > > > *From:* José Luis Larroque [mailto:[email protected]] > *Sent:* Thursday, February 26, 2015 8:55 PM > *To:* [email protected] > *Subject:* Re: Compiling Giraph 1.1 > > > > Hi again guys: > > > I find a solution. *Don't use the clone indicated in the "Quick Start > Guide"*. The pom has 1.2 version, so is looking for dependencies for that > version in maven repositories, and those jar's don't exist, because giraph > 1.2 hasn't been released, yet. > > Instead of doing the clone (sudo git clone > https://github.com/apache/giraph.git), the solution is do the following > steps: > > sudo wget > http://mirrors.nxnethosting.com/apache/giraph/giraph-1.1.0/giraph-dist-1.1.0-src.tar.gz > > sudo tar xzf giraph-dist-1.1.0-src.tar.gz > > sudo chown -R hduser:hadoop giraph-1.1.0 > > sudo mv giraph-dist-1.1.0 giraph > > > > And the build finish without errors, finally!! > > Good bye! > > > > 2015-02-22 23:31 GMT-03:00 José Luis Larroque <[email protected]>: > > Hi Ryan, i'm facing same problem here. Did you find any solution for this? > > I'm building giraph with another hadoop version, but the problem appears > to be the same, that dependency can't be resolved: > mvn -e -Phadoop_yarn -Dhadoop.version=2.4.0 -DskipTests clean install > > I'm not applying the fix of removing STATIC_SASL_SYMBOL from this line: > <munge.symbols>PURE_YARN,STATIC_SASL_SYMBOL</munge.symbols> > > > > 2014-12-08 13:21 GMT-03:00 Ryan <[email protected]>: > > > > Any thoughts? Still not able to install unfortunately. > > > > Ryan > > > > On Sun, Nov 30, 2014 at 9:00 PM, Ryan <[email protected]> > wrote: > > I believe I was. I was building directly from a new clone of the github > repository. It turns out I should be installing YARN instead of the > Hadoop_2 profile. When I run ' mvn -DskipTests > -Dhadoop.version=2.3.0-cdh5.1.2 -Phadoop_yarn clean install' I get the > error: > > > > *Failed to execute goal on project giraph-dist: Could not resolve > dependencies for project org.apache.giraph:giraph-dist:pom:1.2.0-SNAPSHOT: > Failure to find org.apache.giraph:giraph-rexster-io:jar:1.2.0-SNAPSHOT in > http://repo1.maven.org/maven2 <http://repo1.maven.org/maven2> was cached in > the local repository, resolution will not be reattempted until the update > interval of central has elapsed or updates are forced -> [Help 1]* > > > > Would a fix have to do with the giraph-rexster-io:jar:*1.2.0-SNAPSHOT*? > > > > On Sun, Nov 9, 2014 at 7:32 PM, Claudio Martella < > [email protected]> wrote: > > I just built trunk with that command. Are you sure you're building latest > trunk? > > > > On Fri, Nov 7, 2014 at 3:21 PM, Ryan <[email protected]> > wrote: > > Any updated thoughts on this? > > > > On Tue, Nov 4, 2014 at 5:59 PM, Ryan <[email protected]> > wrote: > > It's 'mvn -Phadoop_2 -fae -DskipTests clean install' > > > > Thanks, > > Ryan > > > > On Tue, Nov 4, 2014 at 2:02 PM, Roman Shaposhnik <[email protected]> > wrote: > > What's the exact compilation incantation you use? > > Thanks, > Roman. > > > On Tue, Nov 4, 2014 at 9:56 AM, Ryan <[email protected]> > wrote: > > I'm attempting to build, compile and install Giraph 1.1 on a server > running > > CDH5.1.2. A few weeks ago I successfully compiled it by changing the > > hadoop_2 profile version to be 2.3.0-cdh5.1.2. I recently did a fresh > > install and was unable to build, compile and install (perhaps due to the > > latest code updates). > > > > The error seems to be related to the SaslNettyClient and SaslNettyServer. > > Any idea on fixes? > > > > Here's part of the error log: > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-compiler-plugin:3.0:compile > (default-compile) > > on project giraph-core: Compilation failure: Compilation failure: > > [ERROR] > > > /[myPath]/giraph/giraph-core/src/main/java/org/apache/giraph/comm/netty/SaslNettyClient.java:[28,34] > > cannot find symbol > > [ERROR] symbol: class SaslPropertiesResolver > > [ERROR] location: package org.apache.hadoop.security > > ... > > [ERROR] > > > /[myPath]/giraph/giraph-core/src/main/java/org/apache/giraph/comm/netty/SaslNettyServer.java:[108,11] > > cannot find symbol > > [ERROR] symbol: variable SaslPropertiesResolver > > [ERROR] location: class org.apache.giraph.comm.netty.SaslNettyServer > > > > > > > > > > > > -- > > Claudio Martella > > > > > > > > > >
