MR-279 actually works fine with maven 3.0.3 (sans a few (IMO bogus) warnings). You can leave out the "tar" target (which depends on the "docs" target, which requires forrest 0.8) to unblock the progress, as mvn-install would suffice for common and hdfs builds.
On Thu, Jun 16, 2011 at 7:55 PM, Praveen Sripati <[email protected]> wrote: > Tom, > > I downgraded maven and also changed from open-jdk to sun-jdk and there is > not any progress. I am using Ubuntu 11.04 and could not find sun-java5-jdk > in the Ubuntu repositories, so I installed sun-java6-jdk. > > praveensripati@praveensripati:~$ java -version > java version "1.6.0_24" > Java(TM) SE Runtime Environment (build 1.6.0_24-b07) > > praveensripati@praveensripati:~$ mvn -version > Apache Maven 2.2.1 (r801777; 2009-08-07 00:46:01+0530) > > Thanks, > Praveen > > > On Friday 17 June 2011 02:04 AM, Thomas Graves wrote: >> >> I know at one time maven 3.x didn't work so I've been using maven 2.x. >> >> Well I've never tried using java6 for java5 home but I would think it >> wouldn't work. I thought it was forrest that required java5. I would >> suggest using java5. >> >> Tom >> >> >> On 6/16/11 12:24 PM, "Praveen Sripati"<[email protected]> wrote: >> >>> Tom, >>> >>>>> Note, it looks like your java5.home is pointing to java6? >>> >>> I have java6 on my laptop and pointed java5.home variable to java6. The >>> hadoop doc says "Java 1.6.x - preferable from Sun". Is this the problem? >>> >>>>> What version of protobufs are you using? >>> >>> I have protobuf 2.4.1. >>> >>>>> What about mvn version? >>> >>> Apache Maven 3.0.3 (r1075438; 2011-02-28 23:01:09+0530) >>> >>>>> So you had both common and hdfs built before doing mapreduce and >>> >>> common built before building hdfs? Or was common failing with the error >>> you mention below? If you haven't already you might simply try >>> veryclean on everything and go again in order. >>> I tried common first and there were some errors related to fop, but the >>> common jars were created, so I started with hdfs and it was successful. >>> Then I started the yarn build which led to the >>> java_generate_equals_and_hash error. >>> >>> Thanks, >>> Praveen >>> >>> >>> On Thursday 16 June 2011 09:54 PM, Thomas Graves wrote: >>>> >>>> Note, it looks like your java5.home is pointing to java6? >>>> >>>> I've never seen this particular error. The java_generate_equals_and_hash >>>> option seems to have been added in protobuf2.4.0. What version of >>>> protobufs >>>> are you using? The instructions say to use atleast 2.4.0a, I'm using >>>> 2.4.1 >>>> right now. >>>> >>>> You need to define the following (I use a build.properties file). These >>>> are >>>> the version I'm currently using. All of these are just downloaded from >>>> the >>>> corresponding website. Some links to those can be found here: >>>> http://yahoo.github.com/hadoop-common/installing.html >>>> >>>> java5.home=/home/tgraves/hadoop/jdk1.5.0_22/ >>>> forrest.home=/home/tgraves/hadoop/apache-forrest-0.8 >>>> ant.home=/home/tgraves/hadoop/apache-ant-1.8.2 >>>> xercescroot=/home/tgraves/hadoop/xerces-c-src_2_8_0 >>>> eclipse.home=/home/tgraves/hadoop/eclipse >>>> findbugs.home=/home/tgraves/hadoop/findbugs-1.3.9 >>>> >>>> I thought this was the same as for trunk but perhaps I'm mistaken. >>>> >>>> What about mvn version? >>>> /home/y/libexec/maven/bin/mvn --version >>>> Apache Maven 2.2.1 (r801777; 2009-08-06 19:16:01+0000) >>>> >>>> So you had both common and hdfs built before doing mapreduce and common >>>> built before building hdfs? Or was common failing with the error you >>>> mention >>>> below? If you haven't already you might simply try veryclean on >>>> everything >>>> and go again in order. >>>> >>>> Tom >>>> >>>> >>>> On 6/16/11 8:10 AM, "Praveen Sripati"<[email protected]> wrote: >>>> >>>>> Hi, >>>>> >>>>> The hdfs build was successful after including the -Dforrest.home >>>>> property to the ant command. >>>>> >>>>> *********** >>>>> >>>>> When I started the mapreduce build to get the below error. >>>>> >>>>> mvn clean install assembly:assembly >>>>> >>>>> Downloaded: >>>>> >>>>> http://repo1.maven.org/maven2/org/apache/commons/commons-exec/1.0.1/commons- >>>>> ex >>>>> ec-1.0.1.jar >>>>> (49 KB at 24.4 KB/sec) >>>>> yarn_protos.proto:4:8: Option "java_generate_equals_and_hash" unknown. >>>>> [INFO] >>>>> >>>>> [INFO] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [INFO] Skipping hadoop-mapreduce >>>>> [INFO] This project has been banned from the build due to previous >>>>> failures. >>>>> [INFO] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [INFO] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [INFO] Reactor Summary: >>>>> [INFO] >>>>> [INFO] yarn-api .......................................... FAILURE >>>>> [13:23.081s] >>>>> [INFO] yarn-common ....................................... SKIPPED >>>>> [INFO] yarn-server-common ................................ SKIPPED >>>>> [INFO] yarn-server-nodemanager ........................... SKIPPED >>>>> [INFO] yarn-server-resourcemanager ....................... SKIPPED >>>>> [INFO] yarn-server-tests ................................. SKIPPED >>>>> [INFO] yarn-server ....................................... SKIPPED >>>>> [INFO] yarn .............................................. SKIPPED >>>>> [INFO] hadoop-mapreduce-client-core ...................... SKIPPED >>>>> [INFO] hadoop-mapreduce-client-common .................... SKIPPED >>>>> [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED >>>>> [INFO] hadoop-mapreduce-client-app ....................... SKIPPED >>>>> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED >>>>> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED >>>>> [INFO] hadoop-mapreduce-client ........................... SKIPPED >>>>> [INFO] hadoop-mapreduce .................................. SKIPPED >>>>> [INFO] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [INFO] BUILD FAILURE >>>>> [INFO] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [INFO] Total time: 13:45.437s >>>>> [INFO] Finished at: Thu Jun 16 18:30:48 IST 2011 >>>>> [INFO] Final Memory: 6M/15M >>>>> [INFO] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [ERROR] Failed to execute goal >>>>> org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on >>>>> project yarn-api: Command execution failed. Process exited with an >>>>> error: 1(Exit value: 1) -> [Help 1] >>>>> [ERROR] >>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with >>>>> the >>>>> -e switch. >>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>>>> [ERROR] >>>>> [ERROR] For more information about the errors and possible solutions, >>>>> please read the following articles: >>>>> [ERROR] [Help 1] >>>>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >>>>> >>>>> *********** >>>>> >>>>> I started building the commons and had to include -Djava5.home and >>>>> -Dforrest.home properties in the ant command. >>>>> >>>>> ant -Djava5.home=/usr/lib/jvm/java-6-openjdk >>>>> -Dforrest.home=/home/praveensripati/Installations/apache-forrest-0.9 >>>>> veryclean mvn-install tar >>>>> >>>>> And then I get the below error and the build hangs , but I see 4 jars >>>>> in >>>>> the build folder including hadoop-common-0.22.0-SNAPSHOT.jar. >>>>> >>>>> [exec] Cocoon will report the status of each document: >>>>> [exec] - in column 1: *=okay X=brokenLink ^=pageSkipped (see >>>>> FAQ). >>>>> [exec] >>>>> [exec] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [exec] cocoon 2.1.12-dev >>>>> [exec] Copyright (c) 1999-2007 Apache Software Foundation. All >>>>> rights reserved. >>>>> [exec] >>>>> >>>>> ------------------------------------------------------------------------ >>>>> [exec] >>>>> [exec] >>>>> [exec] * [1/29] [29/29] 6.547s 9.4Kb linkmap.html >>>>> [exec] * [2/29] [1/28] 1.851s 22.3Kb hdfs_shell.html >>>>> [exec] * [4/28] [1/28] 1.156s 21.1Kb distcp.html >>>>> [exec] * [5/27] [0/0] 0.306s 0b distcp.pdf >>>>> [exec] Exception in thread "main" >>>>> java.lang.NoClassDefFoundError: >>>>> org/apache//messaging/MessageHandler >>>>> [exec] at >>>>> >>>>> org.apache.cocoon.serialization.FOPSerializer.configure(FOPSerializer.java:1 >>>>> 22 >>>>> ) >>>>> >>>>> >>>>> I included the following in the common/ivy.xml and the >>>>> ./common/build/ivy/lib/Hadoop-Common/common/fop-0.93.jar file is there. >>>>> >>>>> <dependency org="org.apache.xmlgraphics" >>>>> name="fop" >>>>> rev="${fop.version}" >>>>> conf="common->default"/> >>>>> >>>>> and the following in the common/ivy/libraries.properties and still get >>>>> the same error. >>>>> >>>>> fop.version=0.93 >>>>> >>>>> Thanks, >>>>> Praveen >>>>> >>>>> On Thursday 16 June 2011 07:55 AM, Luke Lu wrote: >>>>>> >>>>>> On Wed, Jun 15, 2011 at 6:45 PM, Praveen Sripati >>>>>> <[email protected]> wrote: >>>>>>> >>>>>>> Do I need the avro-maven-plugin? When I ran the below command got the >>>>>>> error that the pom file was not found. Where do I get the jar and the >>>>>>> pom files for the avro-maven-plugin? I was able to get the source >>>>>>> code >>>>>>> for them, but not the binaries. >>>>>>> >>>>>>> mvn install:install-file >>>>>>> -Dfile=./avro-maven-plugin/avro-maven-plugin-1.4.0-SNAPSHOT.jar >>>>>>> -DpomFile=./avro-maven-plugin/avro-maven-plugin-1.4.0-SNAPSHOT.pom >>>>>> >>>>>> No, you no longer need to install avro-maven-plugin manually. It's >>>>>> automatically installed via maven, as we switched to avro 1.5.1. >>>>>> We'll fix the instruction. >>>>>> >>>>>> __Luke >
