I guess we'll need to clean that guide and divide it in two - For branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may help you just the same: http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <[email protected]> wrote: > That's good to know - is there a more up to date guide than > http://wiki.apache.org/hadoop/HowToContribute which still makes many > references to ant builds? > > > > > -----Original Message----- > From: Harsh J [mailto:[email protected]] > Sent: 11 September 2012 11:36 > To: [email protected] > Subject: Re: hadoop trunk build failure - yarn, surefire related? > > Ah there is no longer a need to run ant anymore on trunk. Ignore the > leftover files in the base MR project directory - those should be > cleaned up soon. All of the functional pieces of the build right now > definitely use Maven. > > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <[email protected]> > wrote: >> Ok - thanks Harsh. >> >> Following Steve's earlier advice I tried the mvn install, which worked fine, >> then ant test in hadoop-mapreduce-project which failed. I was mid-email to >> mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and >> report back. >> >> Tony >> >> >> -----Original Message----- >> From: Harsh J [mailto:[email protected]] >> Sent: 11 September 2012 11:25 >> To: [email protected] >> Subject: Re: hadoop trunk build failure - yarn, surefire related? >> >> Tony, >> >> What I do is: >> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test >> >> This seems to work in running without any missing dependencies at least. >> >> The user lists are all merged, but the developer lists remain separate >> as that works better. >> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <[email protected]> >> wrote: >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can >>> see came from repository.apache.org though. >>> >>> >>> >>> How do I run the MR tests only? >>> >>> >>> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists >>> had merged into one though - did I get the wrong end of the stick? >>> >>> >>> >>> Tony >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> From: Steve Loughran [mailto:[email protected]] >>> Sent: 11 September 2012 10:45 >>> >>> >>> To: [email protected] >>> Subject: Re: hadoop trunk build failure - yarn, surefire related? >>> >>> >>> >>> It's probably some maven thing -in particular Maven's habit of grabbing the >>> online nightly snapshots off apache rather than local, >>> >>> >>> >>> try mvn clean install -DskipTests -offline >>> >>> to force in all the artifacts, then run the MR tests >>> >>> >>> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to >>> discuss build and test process. >>> >>> On 11 September 2012 09:58, Tony Burton <[email protected]> wrote: >>> >>> Hi, >>> >>> >>> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the >>> codebase as part of following the "How To Contribute" guide at >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently >>> failing in hadoop-mapreduce-client-jobclient, the failure message is below - >>> something to do with org.hadoop.yarn.client and/or the maven surefire >>> plugin. Can anyone suggest how to proceed? Thanks! >>> >>> >>> >>> >>> >>> >>> >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Reactor Summary: >>> [INFO] [snipped SKIPPED test groups] >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s] >>> [INFO] >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] BUILD FAILURE >>> [INFO] >>> ------------------------------------------------------------------------ >>> [INFO] Total time: 17.229s >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012 >>> [INFO] Final Memory: 21M/163M >>> [INFO] >>> ------------------------------------------------------------------------ >>> [ERROR] Failed to execute goal >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on >>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: >>> java.lang.reflect.InvocationTargetException; nested exception is >>> java.lang.reflect.InvocationTargetException: null: >>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl >>> -> [Help 1] >>> [ERROR] >>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e >>> switch. >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, please >>> read the following articles: >>> [ERROR] [Help 1] >>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException >>> >>> P Think of the environment: please don't print this email unless you really >>> need to. >>> >>> Outbound Email has been scanned for viruses and SPAM >>> >>> This email and any attachments are confidential, protected by copyright and >>> may be legally privileged. If you are not the intended recipient, then the >>> dissemination or copying of this email is prohibited. If you have received >>> this in error, please notify the sender by replying by email and then delete >>> the email completely from your system. Neither Sporting Index nor the sender >>> accepts responsibility for any virus, or any other defect which might affect >>> any computer or IT system into which the email is received and/or opened. It >>> is the responsibility of the recipient to scan the email and no >>> responsibility is accepted for any loss or damage arising in any way from >>> receipt or use of this email. Sporting Index Ltd is a company registered in >>> England and Wales with company number 2636842, whose registered office is at >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is >>> authorised and regulated by the UK Financial Services Authority (reg. no. >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >>> financial promotion contained herein has been issued and approved by >>> Sporting Index Ltd. >>> >>> >>> >>> Inbound Email has been scanned for viruses and SPAM >>> >>> P Think of the environment: please don't print this email unless you really >>> need to. >>> >>> Outbound Email has been scanned for viruses and SPAM >>> >>> This email and any attachments are confidential, protected by copyright and >>> may be legally privileged. If you are not the intended recipient, then the >>> dissemination or copying of this email is prohibited. If you have received >>> this in error, please notify the sender by replying by email and then delete >>> the email completely from your system. Neither Sporting Index nor the sender >>> accepts responsibility for any virus, or any other defect which might affect >>> any computer or IT system into which the email is received and/or opened. It >>> is the responsibility of the recipient to scan the email and no >>> responsibility is accepted for any loss or damage arising in any way from >>> receipt or use of this email. Sporting Index Ltd is a company registered in >>> England and Wales with company number 2636842, whose registered office is at >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is >>> authorised and regulated by the UK Financial Services Authority (reg. no. >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >>> financial promotion contained herein has been issued and approved by >>> Sporting Index Ltd. >> >> >> >> -- >> Harsh J >> www.sportingindex.com >> Inbound Email has been scanned for viruses and SPAM >> ********************************************************************** >> This email and any attachments are confidential, protected by copyright and >> may be legally privileged. If you are not the intended recipient, then the >> dissemination or copying of this email is prohibited. If you have received >> this in error, please notify the sender by replying by email and then delete >> the email completely from your system. Neither Sporting Index nor the >> sender accepts responsibility for any virus, or any other defect which might >> affect any computer or IT system into which the email is received and/or >> opened. It is the responsibility of the recipient to scan the email and no >> responsibility is accepted for any loss or damage arising in any way from >> receipt or use of this email. Sporting Index Ltd is a company registered in >> England and Wales with company number 2636842, whose registered office is at >> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is >> authorised and regulated by the UK Financial Services Authority (reg. no. >> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >> financial promotion contained herein has been issued >> and approved by Sporting Index Ltd. >> >> Outbound email has been scanned for viruses and SPAM > > > > -- > Harsh J > www.sportingindex.com > Inbound Email has been scanned for viruses and SPAM > ********************************************************************** > This email and any attachments are confidential, protected by copyright and > may be legally privileged. If you are not the intended recipient, then the > dissemination or copying of this email is prohibited. If you have received > this in error, please notify the sender by replying by email and then delete > the email completely from your system. Neither Sporting Index nor the sender > accepts responsibility for any virus, or any other defect which might affect > any computer or IT system into which the email is received and/or opened. It > is the responsibility of the recipient to scan the email and no > responsibility is accepted for any loss or damage arising in any way from > receipt or use of this email. Sporting Index Ltd is a company registered in > England and Wales with company number 2636842, whose registered office is at > Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is > authorised and regulated by the UK Financial Services Authority (reg. no. > 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any > financial promotion contained herein has been issued > and approved by Sporting Index Ltd. > > Outbound email has been scanned for viruses and SPAM -- Harsh J
